Jun 01 09:21:08 devstack cinder-volume[75392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75392) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 01 09:21:08 devstack cinder-volume[75392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75392) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 01 09:21:08 devstack cinder-volume[75392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75392) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 01 09:21:08 devstack cinder-volume[75392]: INFO dbcounter [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Registered counter for database cinder Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_db.sqlalchemy.engines [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75392) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG dbcounter [-] [75392] Writer thread running {{(pid=75392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 01 09:21:09 devstack cinder-volume[75392]: INFO cinder.rpc [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 01 09:21:09 devstack cinder-volume[75392]: INFO cinder.rpc [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_db.sqlalchemy.engines [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75392) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 01 09:21:09 devstack cinder-volume[75392]: INFO cinder.volume.manager [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Determined volume DB was empty at startup. Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG cinder.volume.manager [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75392) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 01 09:21:09 devstack cinder-volume[75392]: INFO cinder.volume.manager [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 01 09:21:09 devstack cinder-volume[75392]: WARNING stevedore.named [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 01 09:21:09 devstack cinder-volume[75392]: WARNING castellan.key_manager [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 01 09:21:09 devstack cinder-volume[75392]: WARNING cinder.keymgr.conf_key_mgr [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG cinder.volume.drivers.lvm [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75392) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_concurrency.processutils [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_concurrency.processutils [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] CMD "cinder-rtstool verify" returned: 0 in 0.376s {{(pid=75392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_db.sqlalchemy.engines [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75392) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 01 09:21:09 devstack cinder-volume[75392]: INFO cinder.rpc [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 01 09:21:09 devstack cinder-volume[75392]: INFO cinder.rpc [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 01 09:21:09 devstack cinder-volume[75392]: WARNING stevedore.named [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 01 09:21:09 devstack cinder-volume[75392]: WARNING castellan.key_manager [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 01 09:21:09 devstack cinder-volume[75392]: INFO cinder.volume.manager [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_db.sqlalchemy.engines [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75392) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 01 09:21:09 devstack cinder-volume[75392]: INFO oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Starting 1 workers Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Started child 75561 {{(pid=75392) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Full set of CONF: {{(pid=75392) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] ******************************************************************************** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Configuration options gathered from: {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] ================================================================================ {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] allow_availability_zone_fallback = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] allow_compression_on_image_upload = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] allowed_direct_url_schemes = [] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] api_rate_limit = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] auth_strategy = keystone {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] az_cache_duration = 3600 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_availability_zone = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_host = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_name = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_stats_polling_interval = 60 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backup_api_class = cinder.backup.api.API {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backup_name_template = backup-%s {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backup_use_same_host = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backup_use_temp_snapshot = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75561]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] chap_password = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] chap_username = {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cinder_internal_tenant_project_id = 7020716b50e5491c914fa060c3795019 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cinder_internal_tenant_user_id = 6725a66266d54362b7ac141d6e0a606e {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cloned_volume_same_az = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cluster = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] compression_format = gzip {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] compute_api_class = cinder.compute.nova.API {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] config_dir = [] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] config_source = [] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] control_exchange = openstack {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] debug = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] default_availability_zone = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] default_group_type = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] default_volume_type = lvmdriver-1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] disk_geometry = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] driver_client_cert = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] driver_client_cert_key = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] driver_data_namespace = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] driver_ssl_cert_path = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] driver_ssl_cert_verify = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] driver_use_ssl = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] enable_force_upload = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] enable_new_services = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] enable_unsupported_driver = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] enforce_multipath_for_image_xfer = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] filter_function = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance_api_insecure = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance_api_servers = ['http://192.168.122.29/image'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance_api_ssl_compression = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance_ca_certificates_file = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance_catalog_info = image:glance:publicURL {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance_certfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance_keyfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance_num_retries = 3 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance_request_timeout = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] goodness_function = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] graceful_shutdown_timeout = 5 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75561]: INFO cinder.volume.manager [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] group_api_class = cinder.group.api.API {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] host = devstack {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] image_compress_on_upload = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] image_conversion_address_space_limit = 1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] image_conversion_cpu_limit = 60 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] image_conversion_disable = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] image_upload_use_cinder_backend = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] image_upload_use_internal_tenant = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] image_volume_cache_enabled = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] image_volume_cache_max_count = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] image_volume_cache_max_size_gb = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] init_host_max_objects_retrieval = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] instance_format = [instance: %(uuid)s] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] iscsi_target_flags = {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] iscsi_write_cache = on {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] iser_helper = tgtadm {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] iser_ip_address = 192.168.122.29 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] iser_port = 3260 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] log_color = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] log_config_append = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] log_dir = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] log_file = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] log_options = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] log_rotate_interval = 1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] log_rotate_interval_type = days {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] log_rotation_type = none {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] max_age = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] max_logfile_count = 30 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] max_logfile_size_mb = 200 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] max_over_subscription_ratio = 20.0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] message_reap_interval = 86400 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] message_ttl = 2592000 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] migration_create_volume_timeout_secs = 300 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] monkey_patch = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] monkey_patch_modules = [] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] my_ip = 192.168.122.29 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] no_snapshot_gb_quota = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] num_iser_scan_tries = 3 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] num_shell_tries = 3 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] num_volume_device_scan_tries = 3 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] nvmeof_conn_info_version = 1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] nvmet_ns_id = 10 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:09 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] nvmet_port_id = 1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] osapi_max_limit = 1000 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] osapi_volume_ext_list = [] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] osapi_volume_listen_port = 8776 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] osapi_volume_use_ssl = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] osapi_volume_workers = 2 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] per_volume_size_limit = -1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] periodic_fuzzy_delay = 60 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] periodic_interval = 60 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] public_endpoint = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] publish_errors = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] quota_backup_gigabytes = 1000 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] quota_backups = 10 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] quota_gigabytes = 1000 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] quota_groups = 10 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] quota_snapshots = 10 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] quota_volumes = 10 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] rate_limit_burst = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack sudo[75565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] rate_limit_except_level = CRITICAL {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] rate_limit_interval = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] reinit_driver_count = 3 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] replication_device = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] report_discard_supported = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] report_interval = 120 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] reservation_clean_interval = 86400 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack sudo[75565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] reservation_expire = 86400 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] reserved_image_namespaces = [] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] reserved_percentage = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] rpc_response_timeout = 120 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] run_external_periodic_tasks = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] scst_target_driver = iscsi {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] scst_target_iqn_name = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] service_down_time = 720 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] shell_completion = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] snapshot_name_template = snapshot-%s {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] snapshot_same_host = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] split_loggers = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] state_path = /opt/stack/data/cinder {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] storage_availability_zone = nova {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] storage_protocol = iSCSI {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] syslog_log_facility = LOG_USER {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] target_helper = lioadm {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] target_ip_address = 192.168.122.29 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] target_port = 3260 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] target_protocol = iscsi {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] target_secondary_ip_addresses = [] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] trace_flags = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] transport_url = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] until_refresh = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] use_chap_auth = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] use_default_quota_class = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] use_journal = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] use_json = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] use_multipath_for_image_xfer = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] use_stderr = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] use_syslog = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] verify_glance_signatures = enabled {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] volume_api_class = cinder.volume.api.API {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] volume_backend_name = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] volume_clear = zero {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] volume_clear_ionice = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] volume_clear_size = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] volume_copy_bps_limit = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] volume_dd_blocksize = 1M {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] volume_name_template = volume-%s {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] volume_service_inithost_offload = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] volume_usage_audit_period = month {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] zoning_mode = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_concurrency.disable_process_locking = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.admin_password = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.admin_token = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.admin_user = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.auth_port = 35357 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.auth_protocol = https {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.auth_section = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.auth_type = password {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.auth_uri = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.auth_version = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.cache = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.certfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.identity_uri = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.include_service_catalog = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.insecure = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.interface = public {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.keyfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_password = {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcache_username = {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.region_name = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.service_type = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.29/identity {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.backend = dogpile.cache.null {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.backend_argument = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.backend_expiration_time = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.config_prefix = cache.oslo {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.debug_cache_backend = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.enable_retry_client = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.enable_socket_keepalive = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.enabled = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.enforce_fips_mode = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.expiration_time = 600 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.hashclient_retry_attempts = 2 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.memcache_dead_retry = 300 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.memcache_pool_maxsize = 10 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.memcache_sasl_enabled = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.password = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.proxies = [] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.redis_db = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.redis_server = localhost:6379 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.retry_attempts = 2 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.retry_delay = 0.0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.socket_keepalive_count = 1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.socket_keepalive_idle = 1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.socket_keepalive_interval = 1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.socket_timeout = 1.0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.tls_allowed_ciphers = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.tls_cafile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.tls_certfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.tls_enabled = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.tls_keyfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cache.username = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] coordination.backend_url = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.asyncio_connection = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.asyncio_slave_connection = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.backend = sqlalchemy {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.connection = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.connection_debug = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.connection_parameters = {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.connection_recycle_time = 3600 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.connection_trace = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.db_inc_retry_interval = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.db_max_retries = 20 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.db_max_retry_interval = 10 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.db_retry_interval = 1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.max_overflow = 50 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.max_pool_size = 5 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.max_retries = 10 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.mysql_wsrep_sync_wait = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.pool_timeout = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.retry_interval = 10 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.slave_connection = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.sqlite_synchronous = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.synchronous_reader = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] database.use_db_reconnect = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] profiler.connection_string = messaging:// {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] profiler.enabled = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] profiler.es_doc_type = notification {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] profiler.es_scroll_size = 10000 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] profiler.es_scroll_time = 2m {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] profiler.filter_error_trace = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] profiler.hmac_keys = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] profiler.sentinel_service_name = mymaster {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] profiler.socket_timeout = 0.1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] profiler.trace_requests = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] profiler.trace_sqlalchemy = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] profiler_jaeger.process_tags = {} {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] profiler_jaeger.service_name_prefix = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] profiler_otlp.service_name_prefix = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_policy.enforce_new_defaults = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: WARNING oslo_config.cfg [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_policy.enforce_scope = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_policy.policy_default_rule = default {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_policy.policy_file = policy.yaml {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] privsep_osbrick.group = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] privsep_osbrick.helper_command = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] privsep_osbrick.user = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cinder_sys_admin.group = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cinder_sys_admin.helper_command = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] cinder_sys_admin.user = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] service_user.auth_section = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] service_user.auth_type = password {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] service_user.cafile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] service_user.certfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] service_user.collect_timing = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] service_user.insecure = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] service_user.keyfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] service_user.send_service_user_token = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] service_user.split_loggers = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] service_user.timeout = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance.auth_section = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance.auth_type = password {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance.certfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance.collect_timing = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance.insecure = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance.keyfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance.region_name = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance.split_loggers = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] glance.timeout = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.backend_availability_zone = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.chap_password = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.chap_username = {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.disk_geometry = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.driver_client_cert = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.driver_client_cert_key = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.driver_data_namespace = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.driver_use_ssl = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.extra_capabilities = {} {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.filter_function = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.goodness_function = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.iscsi_target_flags = {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.iscsi_write_cache = on {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.iser_helper = tgtadm {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.iser_ip_address = 192.168.122.29 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.iser_port = 3260 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.lvm_share_target = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.lvm_type = auto {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.num_shell_tries = 3 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.replication_device = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.report_discard_supported = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.reserved_percentage = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.target_helper = tgtadm {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.target_ip_address = 192.168.122.29 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.target_port = 3260 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.target_protocol = iscsi {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.trace_flags = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.unique_fqdn_network = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.use_chap_auth = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.volume_backend_name = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.volume_clear = zero {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.volume_clear_ionice = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.volume_clear_size = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_reports.file_event_handler = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_reports.log_dir = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.backend_host = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.chap_password = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.chap_username = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.disk_geometry = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.driver_client_cert = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.extra_capabilities = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.filter_function = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.goodness_function = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.iser_helper = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.iser_ip_address = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.iser_port = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.lvm_share_target = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.lvm_type = auto {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.num_shell_tries = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.replication_device = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.report_discard_supported = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.reserved_percentage = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.scst_target_driver = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.storage_protocol = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.target_helper = lioadm {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.target_ip_address = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.target_port = 3260 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.trace_flags = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.use_chap_auth = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.volume_clear = zero {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.volume_clear_size = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] lvmdriver-1.volumes_dir = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack sudo[75565]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack sudo[75719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.ssl = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack sudo[75719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_notifications.driver = [] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:10 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_notifications.retry = -1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] key_manager.fixed_key = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.barbican_api_version = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.barbican_endpoint = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.barbican_endpoint_type = public {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.barbican_region_name = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.cafile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.certfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.collect_timing = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.insecure = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.keyfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.number_of_retries = 60 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.retry_delay = 1 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.send_service_user_token = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.split_loggers = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.timeout = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.verify_ssl = True {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican.verify_ssl_path = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican_service_user.auth_section = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican_service_user.auth_type = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican_service_user.cafile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican_service_user.certfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican_service_user.collect_timing = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican_service_user.insecure = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican_service_user.keyfile = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican_service_user.split_loggers = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] barbican_service_user.timeout = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] vault.approle_role_id = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] vault.approle_secret_id = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] vault.kv_mountpoint = secret {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] vault.kv_path = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] vault.kv_version = 2 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] vault.namespace = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] vault.root_token_id = **** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] vault.ssl_ca_crt_file = None {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] vault.timeout = 60.0 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] vault.use_ssl = False {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:21:11 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] ******************************************************************************** {{(pid=75392) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 01 09:21:11 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.870s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:11 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:11 devstack sudo[75719]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:11 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.635s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:11 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:21:11 devstack cinder-volume[75561]: INFO cinder.brick.local_dev.lvm [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 01 09:21:11 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:11 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:11 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:11 devstack sudo[75911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 01 09:21:11 devstack sudo[75911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:12 devstack sudo[75911]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:12 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:12 devstack cinder-volume[75561]: DEBUG cinder.brick.local_dev.lvm [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75561) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 01 09:21:12 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:12 devstack sudo[76129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 01 09:21:12 devstack sudo[76129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:13 devstack sudo[76129]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:13 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.275s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:13 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:13 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:13 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:13 devstack sudo[76307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 01 09:21:13 devstack sudo[76307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:14 devstack sudo[76307]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:14 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.827s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:14 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:14 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:14 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:14 devstack sudo[76343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 01 09:21:14 devstack sudo[76343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:15 devstack sudo[76343]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:15 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.719s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:15 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:15 devstack sudo[76347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 01 09:21:15 devstack sudo[76347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:15 devstack sudo[76347]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:15 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:15 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:15 devstack sudo[76352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 01 09:21:15 devstack sudo[76352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:16 devstack sudo[76352]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:16 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:16 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:16 devstack sudo[76361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 01 09:21:16 devstack sudo[76361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:17 devstack sudo[76361]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:17 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:17 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:17 devstack sudo[76369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 01 09:21:17 devstack sudo[76369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:17 devstack sudo[76369]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:17 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.823s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:17 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:17 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:17 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:17 devstack sudo[76374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 01 09:21:17 devstack sudo[76374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:18 devstack sudo[76374]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:18 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.891s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:18 devstack cinder-volume[75561]: INFO cinder.volume.drivers.lvm [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 01 09:21:18 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:18 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:18 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:18 devstack sudo[76419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 01 09:21:18 devstack sudo[76419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:19 devstack sudo[76419]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:19 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:19 devstack cinder-volume[75561]: DEBUG cinder.volume.drivers.lvm [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Updating volume stats {{(pid=75561) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 01 09:21:19 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:19 devstack sudo[76497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 01 09:21:19 devstack sudo[76497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:19 devstack cinder-volume[75392]: DEBUG dbcounter [-] [75392] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:21:20 devstack sudo[76497]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:20 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:20 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:20 devstack sudo[76641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 01 09:21:20 devstack sudo[76641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:20 devstack sudo[76641]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:20 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:20 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:20 devstack sudo[76645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 01 09:21:20 devstack sudo[76645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:21 devstack sudo[76645]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:21 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.597s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:21 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:21 devstack sudo[76649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 01 09:21:21 devstack sudo[76649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:21 devstack sudo[76649]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:21 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:21 devstack cinder-volume[75561]: INFO cinder.volume.driver [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Driver hasn't implemented _init_vendor_properties() Jun 01 09:21:21 devstack cinder-volume[75561]: DEBUG cinder.volume.driver [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75561) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 01 09:21:21 devstack cinder-volume[75561]: DEBUG oslo_db.sqlalchemy.engines [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 01 09:21:22 devstack cinder-volume[75561]: DEBUG dbcounter [-] [75561] Writer thread running {{(pid=75561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 01 09:21:22 devstack cinder-volume[75561]: DEBUG cinder.db.sqlalchemy.api [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Building query based on filter {{(pid=75561) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 01 09:21:22 devstack cinder-volume[75561]: DEBUG cinder.image.image_utils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75561) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 01 09:21:22 devstack cinder-volume[75561]: INFO cinder.keymgr.migration [None req-69c5bb28-5912-41a6-8781-59a1f25b476a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 01 09:21:22 devstack cinder-volume[75561]: DEBUG cinder.volume.drivers.lvm [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Updating volume stats {{(pid=75561) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 01 09:21:22 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:22 devstack sudo[76653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 01 09:21:22 devstack sudo[76653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:22 devstack sudo[76653]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:22 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:22 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:22 devstack sudo[76657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 01 09:21:22 devstack sudo[76657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:23 devstack sudo[76657]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:23 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:23 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:23 devstack sudo[76663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 01 09:21:23 devstack sudo[76663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:23 devstack sudo[76663]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:23 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:23 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:23 devstack sudo[76667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 01 09:21:23 devstack sudo[76667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:24 devstack sudo[76667]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:24 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:24 devstack cinder-volume[75561]: DEBUG cinder.manager [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Notifying Schedulers of capabilities ... {{(pid=75561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:21:24 devstack cinder-volume[75561]: INFO cinder.volume.manager [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Driver initialization completed successfully. Jun 01 09:21:24 devstack cinder-volume[75561]: INFO cinder.manager [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Initiating service 2 cleanup Jun 01 09:21:24 devstack cinder-volume[75561]: INFO cinder.manager [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Service 2 cleanup completed. Jun 01 09:21:24 devstack cinder-volume[75561]: DEBUG cinder.service [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Creating RPC server for service cinder-volume {{(pid=75561) start /opt/stack/cinder/cinder/service.py:231}} Jun 01 09:21:24 devstack cinder-volume[75561]: DEBUG cinder.service [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75561) start /opt/stack/cinder/cinder/service.py:237}} Jun 01 09:21:24 devstack cinder-volume[75561]: INFO cinder.volume.manager [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 01 09:21:24 devstack cinder-volume[75561]: DEBUG cinder.volume.drivers.lvm [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Updating volume stats {{(pid=75561) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 01 09:21:24 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:24 devstack sudo[76672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 01 09:21:24 devstack sudo[76672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:25 devstack sudo[76672]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:25 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:25 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:25 devstack sudo[76675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 01 09:21:25 devstack sudo[76675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:26 devstack sudo[76675]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:26 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:26 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:26 devstack sudo[76696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 01 09:21:26 devstack sudo[76696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:26 devstack sudo[76696]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:26 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.599s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:26 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:21:26 devstack sudo[76738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 01 09:21:26 devstack sudo[76738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:21:27 devstack sudo[76738]: pam_unix(sudo:session): session closed for user root Jun 01 09:21:27 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:21:27 devstack cinder-volume[75561]: INFO cinder.volume.manager [None req-8b770633-3795-415d-bc6a-27aaabd10947 None None] Driver post RPC initialization completed successfully. Jun 01 09:21:37 devstack cinder-volume[75561]: DEBUG dbcounter [-] [75561] Writing DB stats cinder:SELECT=3 {{(pid=75561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:21:37 devstack cinder-volume[75561]: DEBUG dbcounter [-] [75561] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:23:02 devstack cinder-volume[75561]: DEBUG oslo_service.periodic_task [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:23:02 devstack cinder-volume[75561]: DEBUG cinder.volume.drivers.lvm [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Updating volume stats {{(pid=75561) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 01 09:23:02 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:23:02 devstack sudo[81448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 01 09:23:02 devstack sudo[81448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:23:02 devstack sudo[81448]: pam_unix(sudo:session): session closed for user root Jun 01 09:23:02 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:23:02 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:23:02 devstack sudo[81469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 01 09:23:02 devstack sudo[81469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:23:03 devstack sudo[81469]: pam_unix(sudo:session): session closed for user root Jun 01 09:23:03 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:23:03 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:23:03 devstack sudo[81488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 01 09:23:03 devstack sudo[81488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:23:04 devstack sudo[81488]: pam_unix(sudo:session): session closed for user root Jun 01 09:23:04 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.598s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:23:04 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:23:04 devstack sudo[81493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 01 09:23:04 devstack sudo[81493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:23:04 devstack sudo[81493]: pam_unix(sudo:session): session closed for user root Jun 01 09:23:04 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:23:04 devstack cinder-volume[75561]: DEBUG cinder.manager [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Notifying Schedulers of capabilities ... {{(pid=75561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:23:37 devstack cinder-volume[75561]: DEBUG dbcounter [-] [75561] Writing DB stats cinder:SELECT=1 {{(pid=75561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:23:37 devstack cinder-volume[75561]: DEBUG dbcounter [-] [75561] Writing DB stats cinder:UPDATE=1 {{(pid=75561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:24:02 devstack cinder-volume[75561]: DEBUG oslo_service.periodic_task [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:24:02 devstack cinder-volume[75561]: DEBUG cinder.volume.drivers.lvm [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Updating volume stats {{(pid=75561) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 01 09:24:02 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:24:02 devstack sudo[82737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 01 09:24:02 devstack sudo[82737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:24:02 devstack sudo[82737]: pam_unix(sudo:session): session closed for user root Jun 01 09:24:02 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:24:02 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:24:02 devstack sudo[82747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 01 09:24:02 devstack sudo[82747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:24:03 devstack sudo[82747]: pam_unix(sudo:session): session closed for user root Jun 01 09:24:03 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.598s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:24:03 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:24:03 devstack sudo[82751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 01 09:24:03 devstack sudo[82751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:24:04 devstack sudo[82751]: pam_unix(sudo:session): session closed for user root Jun 01 09:24:04 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.568s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:24:04 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:24:04 devstack sudo[82758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 01 09:24:04 devstack sudo[82758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:24:04 devstack sudo[82758]: pam_unix(sudo:session): session closed for user root Jun 01 09:24:04 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.591s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:24:04 devstack cinder-volume[75561]: DEBUG cinder.manager [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Notifying Schedulers of capabilities ... {{(pid=75561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:25:02 devstack cinder-volume[75561]: DEBUG oslo_service.periodic_task [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:25:02 devstack cinder-volume[75561]: DEBUG cinder.volume.drivers.lvm [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Updating volume stats {{(pid=75561) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 01 09:25:02 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:25:02 devstack sudo[84524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 01 09:25:02 devstack sudo[84524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:25:02 devstack sudo[84524]: pam_unix(sudo:session): session closed for user root Jun 01 09:25:02 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:25:02 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:25:02 devstack sudo[84603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 01 09:25:02 devstack sudo[84603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:25:03 devstack sudo[84603]: pam_unix(sudo:session): session closed for user root Jun 01 09:25:03 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.578s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:25:03 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:25:03 devstack sudo[84606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 01 09:25:03 devstack sudo[84606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:25:04 devstack sudo[84606]: pam_unix(sudo:session): session closed for user root Jun 01 09:25:04 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.601s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:25:04 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:25:04 devstack sudo[84612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 01 09:25:04 devstack sudo[84612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:25:04 devstack sudo[84612]: pam_unix(sudo:session): session closed for user root Jun 01 09:25:04 devstack cinder-volume[75561]: DEBUG oslo_concurrency.processutils [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=75561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:25:04 devstack cinder-volume[75561]: DEBUG cinder.manager [None req-e1452d6f-eddc-49a6-ad8b-f6bc632f6028 None None] Notifying Schedulers of capabilities ... {{(pid=75561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:25:37 devstack cinder-volume[75561]: DEBUG dbcounter [-] [75561] Writing DB stats cinder:SELECT=1 {{(pid=75561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:25:37 devstack cinder-volume[75561]: DEBUG dbcounter [-] [75561] Writing DB stats cinder:UPDATE=1 {{(pid=75561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:25:47 devstack cinder-volume[75392]: INFO oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Caught SIGTERM, stopping children Jun 01 09:25:47 devstack cinder-volume[75392]: DEBUG oslo_concurrency.lockutils [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Acquiring lock "singleton_lock" {{(pid=75392) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 01 09:25:47 devstack cinder-volume[75392]: DEBUG oslo_concurrency.lockutils [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Acquired lock "singleton_lock" {{(pid=75392) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 01 09:25:47 devstack cinder-volume[75392]: DEBUG oslo_concurrency.lockutils [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Releasing lock "singleton_lock" {{(pid=75392) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 01 09:25:47 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Stop services. {{(pid=75392) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 01 09:25:47 devstack cinder-volume[75392]: DEBUG oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Killing children. {{(pid=75392) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 01 09:25:47 devstack cinder-volume[75392]: INFO oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Waiting on 1 children to exit Jun 01 09:25:49 devstack cinder-volume[75561]: DEBUG oslo_concurrency.lockutils [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Acquiring lock "singleton_lock" {{(pid=75561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 01 09:25:49 devstack cinder-volume[75561]: DEBUG oslo_concurrency.lockutils [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Acquired lock "singleton_lock" {{(pid=75561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 01 09:25:49 devstack cinder-volume[75561]: DEBUG oslo_concurrency.lockutils [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Releasing lock "singleton_lock" {{(pid=75561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 01 09:25:49 devstack cinder-volume[75561]: WARNING amqp [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 01 09:25:49 devstack cinder-volume[75561]: WARNING amqp [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 01 09:25:49 devstack cinder-volume[75392]: INFO oslo_service.backend._eventlet.service [None req-1b75a07e-818e-4425-8251-277e06e09e27 None None] Child 75561 exited with status 0 Jun 01 09:25:52 devstack cinder-volume[85642]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85642) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 01 09:25:52 devstack cinder-volume[85642]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85642) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 01 09:25:52 devstack cinder-volume[85642]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85642) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 01 09:25:52 devstack cinder-volume[85642]: INFO dbcounter [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Registered counter for database cinder Jun 01 09:25:52 devstack cinder-volume[85642]: DEBUG oslo_db.sqlalchemy.engines [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85642) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 01 09:25:52 devstack cinder-volume[85642]: DEBUG dbcounter [-] [85642] Writer thread running {{(pid=85642) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 01 09:25:52 devstack cinder-volume[85642]: INFO cinder.rpc [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 01 09:25:52 devstack cinder-volume[85642]: INFO cinder.rpc [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 01 09:25:52 devstack cinder-volume[85642]: DEBUG oslo_db.sqlalchemy.engines [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85642) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 01 09:25:53 devstack cinder-volume[85642]: INFO cinder.volume.manager [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Determined volume DB was empty at startup. Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG cinder.volume.manager [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85642) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 01 09:25:53 devstack cinder-volume[85642]: INFO cinder.volume.manager [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 01 09:25:53 devstack cinder-volume[85642]: WARNING stevedore.named [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 01 09:25:53 devstack cinder-volume[85642]: WARNING castellan.key_manager [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 01 09:25:53 devstack cinder-volume[85642]: WARNING cinder.keymgr.conf_key_mgr [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 01 09:25:53 devstack cinder-volume[85642]: INFO cinder.volume.manager [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_db.sqlalchemy.engines [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85642) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 01 09:25:53 devstack cinder-volume[85642]: INFO oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Starting 1 workers Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Started child 85779 {{(pid=85642) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Full set of CONF: {{(pid=85642) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] ******************************************************************************** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Configuration options gathered from: {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] ================================================================================ {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] allow_availability_zone_fallback = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] allow_compression_on_image_upload = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] allowed_direct_url_schemes = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] api_rate_limit = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] auth_strategy = keystone {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_availability_zone = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85779]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_host = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_stats_polling_interval = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backup_api_class = cinder.backup.api.API {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backup_name_template = backup-%s {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backup_use_same_host = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backup_use_temp_snapshot = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] chap_password = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] chap_username = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cinder_internal_tenant_project_id = 7020716b50e5491c914fa060c3795019 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cinder_internal_tenant_user_id = 6725a66266d54362b7ac141d6e0a606e {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cluster = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] compression_format = gzip {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] compute_api_class = cinder.compute.nova.API {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] config_dir = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] config_source = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] control_exchange = openstack {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] debug = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] default_availability_zone = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] default_group_type = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] default_volume_type = QuobyteHD {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] disk_geometry = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] driver_client_cert = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] driver_client_cert_key = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] driver_data_namespace = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] driver_ssl_cert_path = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] driver_ssl_cert_verify = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] driver_use_ssl = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] enable_new_services = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] enable_unsupported_driver = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] enabled_backends = ['QuobyteHD'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] enforce_multipath_for_image_xfer = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] filter_function = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance_api_insecure = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance_api_servers = ['http://192.168.122.29/image'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance_api_ssl_compression = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance_ca_certificates_file = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance_catalog_info = image:glance:publicURL {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance_certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance_keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance_num_retries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance_request_timeout = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] goodness_function = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] graceful_shutdown_timeout = 5 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] group_api_class = cinder.group.api.API {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] host = devstack {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] image_compress_on_upload = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] image_conversion_address_space_limit = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] image_conversion_cpu_limit = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] image_conversion_disable = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] image_upload_use_cinder_backend = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] image_upload_use_internal_tenant = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] image_volume_cache_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] image_volume_cache_max_count = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] image_volume_cache_max_size_gb = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] init_host_max_objects_retrieval = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] instance_format = [instance: %(uuid)s] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] iscsi_target_flags = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] iscsi_write_cache = on {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] iser_helper = tgtadm {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] iser_ip_address = 192.168.122.29 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] iser_port = 3260 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] log_color = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] log_config_append = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] log_dir = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] log_file = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] log_options = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] log_rotate_interval = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] log_rotate_interval_type = days {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] log_rotation_type = none {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] max_age = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] max_logfile_count = 30 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] max_logfile_size_mb = 200 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] max_over_subscription_ratio = 20.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] message_reap_interval = 86400 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] message_ttl = 2592000 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] migration_create_volume_timeout_secs = 300 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] monkey_patch = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] monkey_patch_modules = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] my_ip = 192.168.122.29 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] no_snapshot_gb_quota = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] num_iser_scan_tries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] num_shell_tries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] num_volume_device_scan_tries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] nvmeof_conn_info_version = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] nvmet_ns_id = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] nvmet_port_id = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] osapi_max_limit = 1000 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85779]: INFO cinder.volume.manager [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Starting volume driver QuobyteDriver (1.1.14) Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] osapi_volume_ext_list = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85779]: DEBUG cinder.volume.drivers.remotefs [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85779) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] osapi_volume_listen_port = 8776 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] osapi_volume_use_ssl = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] osapi_volume_workers = 2 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] per_volume_size_limit = -1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] periodic_fuzzy_delay = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] periodic_interval = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] public_endpoint = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] publish_errors = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] quota_backup_gigabytes = 1000 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] quota_backups = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] quota_gigabytes = 1000 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] quota_groups = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] quota_snapshots = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] quota_volumes = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] rate_limit_burst = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] rate_limit_except_level = CRITICAL {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] rate_limit_interval = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] reinit_driver_count = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] replication_device = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] report_discard_supported = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] report_interval = 120 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] reservation_clean_interval = 86400 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] reservation_expire = 86400 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] reserved_image_namespaces = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] reserved_percentage = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] rpc_response_timeout = 120 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] run_external_periodic_tasks = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] scst_target_driver = iscsi {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] scst_target_iqn_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] service_down_time = 720 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] shell_completion = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] snapshot_name_template = snapshot-%s {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] split_loggers = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] state_path = /opt/stack/data/cinder {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] storage_availability_zone = nova {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] storage_protocol = iSCSI {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] syslog_log_facility = LOG_USER {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] target_helper = lioadm {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] target_ip_address = 192.168.122.29 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] target_port = 3260 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] target_protocol = iscsi {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] target_secondary_ip_addresses = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] trace_flags = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] transport_url = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] until_refresh = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] use_chap_auth = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] use_default_quota_class = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] use_journal = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] use_json = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] use_multipath_for_image_xfer = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] use_stderr = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] use_syslog = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] verify_glance_signatures = enabled {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] volume_api_class = cinder.volume.api.API {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] volume_backend_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] volume_clear = zero {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] volume_clear_ionice = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] volume_clear_size = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] volume_copy_bps_limit = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] volume_dd_blocksize = 1M {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] volume_name_template = volume-%s {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] volume_service_inithost_offload = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] volume_usage_audit_period = month {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] zoning_mode = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_concurrency.disable_process_locking = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.admin_password = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.admin_token = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.admin_user = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.auth_admin_prefix = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.auth_port = 35357 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.auth_protocol = https {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.auth_section = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.auth_type = password {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.auth_uri = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.auth_version = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.cache = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.identity_uri = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.include_service_catalog = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.insecure = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.interface = public {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_password = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcache_username = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.region_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.service_token_roles_required = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.service_type = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.29/identity {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.backend = dogpile.cache.null {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.backend_argument = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.backend_expiration_time = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.config_prefix = cache.oslo {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.debug_cache_backend = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.enable_retry_client = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.enable_socket_keepalive = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.enforce_fips_mode = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.expiration_time = 600 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.hashclient_retry_attempts = 2 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.memcache_dead_retry = 300 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.memcache_pool_maxsize = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.memcache_sasl_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.password = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.proxies = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.redis_db = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.redis_server = localhost:6379 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.retry_attempts = 2 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.retry_delay = 0.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.socket_keepalive_count = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.socket_keepalive_idle = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.socket_keepalive_interval = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.socket_timeout = 1.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.tls_allowed_ciphers = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.tls_cafile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.tls_certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.tls_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.tls_keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cache.username = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] coordination.backend_url = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.asyncio_connection = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.asyncio_slave_connection = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.backend = sqlalchemy {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.connection = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.connection_debug = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.connection_parameters = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.connection_recycle_time = 3600 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.connection_trace = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.db_inc_retry_interval = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.db_max_retries = 20 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.db_max_retry_interval = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.db_retry_interval = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.max_overflow = 50 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.max_pool_size = 5 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.max_retries = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.mysql_wsrep_sync_wait = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.pool_timeout = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.retry_interval = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.slave_connection = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.sqlite_synchronous = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.synchronous_reader = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] database.use_db_reconnect = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] profiler.connection_string = messaging:// {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] profiler.enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] profiler.es_doc_type = notification {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] profiler.es_scroll_size = 10000 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] profiler.es_scroll_time = 2m {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] profiler.filter_error_trace = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] profiler.hmac_keys = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] profiler.sentinel_service_name = mymaster {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] profiler.socket_timeout = 0.1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] profiler.trace_requests = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] profiler.trace_sqlalchemy = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] profiler_jaeger.process_tags = {} {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] profiler_jaeger.service_name_prefix = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] profiler_otlp.service_name_prefix = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_policy.enforce_new_defaults = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: WARNING oslo_config.cfg [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_policy.enforce_scope = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_policy.policy_default_rule = default {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85779]: DEBUG cinder.volume.drivers.quobyte [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85779) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 01 09:25:53 devstack cinder-volume[85779]: WARNING cinder.volume.drivers.quobyte [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 01 09:25:53 devstack cinder-volume[85779]: WARNING cinder.volume.drivers.quobyte [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 01 09:25:53 devstack cinder-volume[85779]: DEBUG oslo_concurrency.processutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Running cmd (subprocess): mount.quobyte {{(pid=85779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_policy.policy_file = policy.yaml {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] privsep_osbrick.group = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] privsep_osbrick.helper_command = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] privsep_osbrick.user = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cinder_sys_admin.group = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cinder_sys_admin.helper_command = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] cinder_sys_admin.user = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] service_user.auth_section = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] service_user.auth_type = password {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] service_user.cafile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] service_user.certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] service_user.collect_timing = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] service_user.insecure = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] service_user.keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] service_user.send_service_user_token = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] service_user.split_loggers = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] service_user.timeout = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance.auth_section = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance.auth_type = password {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance.certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance.collect_timing = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance.insecure = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance.keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance.region_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance.split_loggers = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] glance.timeout = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.backend_availability_zone = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.chap_password = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.chap_username = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.disk_geometry = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.driver_client_cert = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.driver_client_cert_key = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.driver_data_namespace = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.driver_use_ssl = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.extra_capabilities = {} {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.filter_function = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.goodness_function = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.iscsi_target_flags = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.iscsi_write_cache = on {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.iser_helper = tgtadm {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.iser_ip_address = 192.168.122.29 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.iser_port = 3260 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.nas_host = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.nas_login = admin {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.nas_mount_options = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.nas_password = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.nas_private_key = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.nas_share_path = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.num_shell_tries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.quobyte_volume_url = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.replication_device = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.report_discard_supported = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.reserved_percentage = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.target_helper = tgtadm {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.target_ip_address = 192.168.122.29 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.target_port = 3260 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.target_protocol = iscsi {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.trace_flags = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.unique_fqdn_network = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.use_chap_auth = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.volume_backend_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.volume_clear = zero {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.volume_clear_ionice = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.volume_clear_size = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_reports.file_event_handler = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_reports.log_dir = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.backend_availability_zone = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.backend_host = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.chap_password = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.chap_username = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.chiscsi_conf = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.disk_geometry = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.driver_client_cert = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.driver_data_namespace = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.driver_use_ssl = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.extra_capabilities = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.filter_function = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.goodness_function = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.iser_helper = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.iser_ip_address = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.iser_port = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.iser_target_prefix = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.nas_host = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.nas_login = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.nas_mount_options = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.nas_password = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.nas_private_key = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.nas_share_path = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.nas_ssh_port = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.num_shell_tries = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.nvmet_port_id = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.replication_device = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.report_discard_supported = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.reserved_percentage = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.scst_target_driver = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.storage_protocol = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.target_helper = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.target_ip_address = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.target_port = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.target_prefix = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.target_protocol = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.trace_flags = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.use_chap_auth = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.volume_clear = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.volume_clear_size = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] QuobyteHD.volumes_dir = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.ssl = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_notifications.driver = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_notifications.retry = -1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] key_manager.fixed_key = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.barbican_api_version = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.barbican_endpoint = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.barbican_endpoint_type = public {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.barbican_region_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.cafile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.collect_timing = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.insecure = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.number_of_retries = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.retry_delay = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.send_service_user_token = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.split_loggers = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.timeout = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.verify_ssl = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican.verify_ssl_path = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican_service_user.auth_section = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican_service_user.auth_type = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican_service_user.cafile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican_service_user.certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican_service_user.collect_timing = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican_service_user.insecure = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican_service_user.keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican_service_user.split_loggers = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] barbican_service_user.timeout = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] vault.approle_role_id = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] vault.approle_secret_id = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] vault.kv_mountpoint = secret {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] vault.kv_path = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] vault.kv_version = 2 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] vault.namespace = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] vault.root_token_id = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] vault.ssl_ca_crt_file = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] vault.timeout = 60.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] vault.use_ssl = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:25:53 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] ******************************************************************************** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 01 09:25:53 devstack cinder-volume[85779]: DEBUG oslo_concurrency.processutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] CMD "mount.quobyte" returned: 1 in 0.150s {{(pid=85779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:25:53 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85779) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:25:53 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85779) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:25:53 devstack cinder-volume[85779]: DEBUG cinder.volume.drivers.quobyte [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=85779) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:25:53 devstack cinder-volume[85779]: INFO cinder.volume.drivers.quobyte [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 ... Jun 01 09:25:53 devstack cinder-volume[85779]: DEBUG oslo_concurrency.processutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e -c /etc/quobyte/client-cinder.cfg {{(pid=85779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:25:53 devstack sudo[85858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e -c /etc/quobyte/client-cinder.cfg Jun 01 09:25:53 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:25:54 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root Jun 01 09:25:54 devstack cinder-volume[85779]: DEBUG oslo_concurrency.processutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.770s {{(pid=85779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:25:54 devstack cinder-volume[85779]: INFO cinder.volume.drivers.quobyte [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 succeeded Jun 01 09:25:54 devstack cinder-volume[85779]: DEBUG cinder.volume.drivers.quobyte [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=85779) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:25:54 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.784s {{(pid=85779) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:25:54 devstack cinder-volume[85779]: DEBUG oslo_concurrency.processutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=85779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:25:54 devstack sudo[85931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:25:54 devstack sudo[85931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:25:55 devstack sudo[85931]: pam_unix(sudo:session): session closed for user root Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG oslo_concurrency.processutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.604s {{(pid=85779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:25:55 devstack cinder-volume[85779]: INFO cinder.volume.driver [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Driver hasn't implemented _init_vendor_properties() Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG cinder.volume.driver [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85779) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG oslo_db.sqlalchemy.engines [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85779) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG dbcounter [-] [85779] Writer thread running {{(pid=85779) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG cinder.db.sqlalchemy.api [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Building query based on filter {{(pid=85779) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG cinder.image.image_utils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85779) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 01 09:25:55 devstack cinder-volume[85779]: INFO cinder.keymgr.migration [None req-a54a127e-3ac5-4e0a-8582-0179a439cfe6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85779) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85779) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG cinder.volume.drivers.quobyte [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=85779) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG cinder.volume.drivers.quobyte [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=85779) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85779) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG oslo_concurrency.processutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=85779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:25:55 devstack sudo[85935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:25:55 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:25:55 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG oslo_concurrency.processutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.577s {{(pid=85779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG cinder.manager [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Notifying Schedulers of capabilities ... {{(pid=85779) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:25:55 devstack cinder-volume[85779]: INFO cinder.volume.manager [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Driver initialization completed successfully. Jun 01 09:25:55 devstack cinder-volume[85779]: INFO cinder.manager [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Initiating service 3 cleanup Jun 01 09:25:55 devstack cinder-volume[85779]: INFO cinder.manager [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Service 3 cleanup completed. Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG cinder.service [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Creating RPC server for service cinder-volume {{(pid=85779) start /opt/stack/cinder/cinder/service.py:231}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG cinder.service [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85779) start /opt/stack/cinder/cinder/service.py:237}} Jun 01 09:25:55 devstack cinder-volume[85779]: INFO cinder.volume.manager [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85779) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85779) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG cinder.volume.drivers.quobyte [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=85779) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG cinder.volume.drivers.quobyte [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=85779) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85779) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:25:55 devstack cinder-volume[85779]: DEBUG oslo_concurrency.processutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=85779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:25:55 devstack sudo[85940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:25:55 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:25:56 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root Jun 01 09:25:56 devstack cinder-volume[85779]: DEBUG oslo_concurrency.processutils [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.639s {{(pid=85779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:25:56 devstack cinder-volume[85779]: INFO cinder.volume.manager [None req-03246df2-bcfa-4f78-a125-6240ee4c094d None None] Driver post RPC initialization completed successfully. Jun 01 09:26:00 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-d43aec07-0e3e-4b69-b3e7-42e341aac534 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85779) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:26:00 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-d43aec07-0e3e-4b69-b3e7-42e341aac534 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85779) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:26:00 devstack cinder-volume[85779]: DEBUG cinder.volume.drivers.quobyte [None req-d43aec07-0e3e-4b69-b3e7-42e341aac534 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=85779) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:26:00 devstack cinder-volume[85779]: DEBUG cinder.volume.drivers.quobyte [None req-d43aec07-0e3e-4b69-b3e7-42e341aac534 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=85779) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:26:00 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-d43aec07-0e3e-4b69-b3e7-42e341aac534 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85779) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:26:00 devstack cinder-volume[85779]: DEBUG oslo_concurrency.processutils [None req-d43aec07-0e3e-4b69-b3e7-42e341aac534 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=85779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:26:00 devstack sudo[86121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:26:00 devstack sudo[86121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:26:01 devstack sudo[86121]: pam_unix(sudo:session): session closed for user root Jun 01 09:26:01 devstack cinder-volume[85779]: DEBUG oslo_concurrency.processutils [None req-d43aec07-0e3e-4b69-b3e7-42e341aac534 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.577s {{(pid=85779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:26:01 devstack cinder-volume[85779]: DEBUG cinder.manager [None req-d43aec07-0e3e-4b69-b3e7-42e341aac534 None None] Notifying Schedulers of capabilities ... {{(pid=85779) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:26:03 devstack cinder-volume[85642]: DEBUG dbcounter [-] [85642] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85642) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:26:04 devstack cinder-volume[85642]: INFO oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Caught SIGTERM, stopping children Jun 01 09:26:04 devstack cinder-volume[85642]: DEBUG oslo_concurrency.lockutils [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Acquiring lock "singleton_lock" {{(pid=85642) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 01 09:26:04 devstack cinder-volume[85642]: DEBUG oslo_concurrency.lockutils [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Acquired lock "singleton_lock" {{(pid=85642) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 01 09:26:04 devstack cinder-volume[85642]: DEBUG oslo_concurrency.lockutils [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Releasing lock "singleton_lock" {{(pid=85642) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 01 09:26:04 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Stop services. {{(pid=85642) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 01 09:26:04 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Killing children. {{(pid=85642) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 01 09:26:04 devstack cinder-volume[85642]: INFO oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Waiting on 1 children to exit Jun 01 09:26:06 devstack cinder-volume[85779]: DEBUG dbcounter [-] [85779] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85779) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:26:06 devstack cinder-volume[85779]: DEBUG dbcounter [-] [85779] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=85779) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:26:09 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Acquiring lock "singleton_lock" {{(pid=85779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 01 09:26:09 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Acquired lock "singleton_lock" {{(pid=85779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 01 09:26:09 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Releasing lock "singleton_lock" {{(pid=85779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 01 09:26:09 devstack cinder-volume[85779]: WARNING amqp [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 01 09:26:09 devstack cinder-volume[85779]: WARNING amqp [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 01 09:26:09 devstack cinder-volume[85642]: INFO oslo_service.backend._eventlet.service [None req-c4464ea1-0bc9-4413-8115-fe18b5f51417 None None] Child 85779 exited with status 0 Jun 01 09:26:12 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86387) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 01 09:26:12 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86387) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 01 09:26:12 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86387) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 01 09:26:12 devstack cinder-volume[86387]: INFO dbcounter [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] Registered counter for database cinder Jun 01 09:26:12 devstack cinder-volume[86387]: DEBUG oslo_db.sqlalchemy.engines [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86387) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG dbcounter [-] [86387] Writer thread running {{(pid=86387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 01 09:26:13 devstack cinder-volume[86387]: INFO cinder.rpc [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 01 09:26:13 devstack cinder-volume[86387]: INFO cinder.rpc [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_db.sqlalchemy.engines [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86387) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 01 09:26:13 devstack cinder-volume[86387]: INFO cinder.volume.manager [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] Determined volume DB was empty at startup. Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG cinder.volume.manager [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86387) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 01 09:26:13 devstack cinder-volume[86387]: WARNING stevedore.named [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 01 09:26:13 devstack cinder-volume[86387]: WARNING castellan.key_manager [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 01 09:26:13 devstack cinder-volume[86387]: WARNING cinder.keymgr.conf_key_mgr [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 01 09:26:13 devstack cinder-volume[86387]: INFO cinder.volume.manager [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_db.sqlalchemy.engines [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86387) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 01 09:26:13 devstack cinder-volume[86387]: INFO oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] Starting 1 workers Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] Started child 86649 {{(pid=86387) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] Full set of CONF: {{(pid=86387) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] ******************************************************************************** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] Configuration options gathered from: {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] ================================================================================ {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] allow_availability_zone_fallback = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] allow_compression_on_image_upload = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] allowed_direct_url_schemes = [] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] api_rate_limit = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86649]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] auth_strategy = keystone {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_availability_zone = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_host = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_name = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_stats_polling_interval = 60 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backup_api_class = cinder.backup.api.API {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backup_name_template = backup-%s {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backup_use_same_host = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backup_use_temp_snapshot = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] chap_password = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] chap_username = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cinder_internal_tenant_project_id = 7020716b50e5491c914fa060c3795019 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cinder_internal_tenant_user_id = 6725a66266d54362b7ac141d6e0a606e {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cluster = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] compression_format = gzip {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] compute_api_class = cinder.compute.nova.API {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] config_dir = [] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] config_source = [] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] control_exchange = openstack {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] debug = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] default_availability_zone = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] default_group_type = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] default_volume_type = QuobyteHD {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] disk_geometry = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] driver_client_cert = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] driver_client_cert_key = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] driver_data_namespace = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] driver_ssl_cert_path = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] driver_ssl_cert_verify = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] driver_use_ssl = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] enable_new_services = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] enable_unsupported_driver = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] enabled_backends = ['QuobyteHD'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] enforce_multipath_for_image_xfer = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] filter_function = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance_api_insecure = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance_api_servers = ['http://192.168.122.29/image'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance_api_ssl_compression = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance_ca_certificates_file = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance_catalog_info = image:glance:publicURL {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance_certfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance_keyfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance_num_retries = 3 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance_request_timeout = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] goodness_function = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] graceful_shutdown_timeout = 5 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] group_api_class = cinder.group.api.API {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] host = devstack {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] image_compress_on_upload = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] image_conversion_address_space_limit = 1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] image_conversion_cpu_limit = 60 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] image_conversion_disable = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] image_upload_use_cinder_backend = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] image_upload_use_internal_tenant = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] image_volume_cache_enabled = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] image_volume_cache_max_count = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] image_volume_cache_max_size_gb = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] init_host_max_objects_retrieval = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] instance_format = [instance: %(uuid)s] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] iscsi_target_flags = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] iscsi_write_cache = on {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] iser_helper = tgtadm {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] iser_ip_address = 192.168.122.29 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] iser_port = 3260 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] log_color = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] log_config_append = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] log_dir = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] log_file = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] log_options = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] log_rotate_interval = 1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] log_rotate_interval_type = days {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] log_rotation_type = none {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] max_age = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] max_logfile_count = 30 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] max_logfile_size_mb = 200 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] max_over_subscription_ratio = 20.0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] message_reap_interval = 86400 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] message_ttl = 2592000 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] migration_create_volume_timeout_secs = 300 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] monkey_patch = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] monkey_patch_modules = [] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] my_ip = 192.168.122.29 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] no_snapshot_gb_quota = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] num_iser_scan_tries = 3 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] num_shell_tries = 3 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] num_volume_device_scan_tries = 3 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] nvmeof_conn_info_version = 1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] nvmet_ns_id = 10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] nvmet_port_id = 1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] osapi_max_limit = 1000 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] osapi_volume_ext_list = [] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] osapi_volume_listen_port = 8776 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] osapi_volume_use_ssl = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] osapi_volume_workers = 2 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] per_volume_size_limit = -1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] periodic_fuzzy_delay = 60 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] periodic_interval = 60 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] public_endpoint = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] publish_errors = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] quota_backup_gigabytes = 1000 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] quota_backups = 10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] quota_gigabytes = 1000 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] quota_groups = 10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86649) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] quota_snapshots = 10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] quota_volumes = 10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] rate_limit_burst = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] rate_limit_except_level = CRITICAL {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] rate_limit_interval = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] reinit_driver_count = 3 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] replication_device = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] report_discard_supported = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] report_interval = 120 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] reservation_clean_interval = 86400 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] reservation_expire = 86400 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] reserved_image_namespaces = [] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] reserved_percentage = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] rpc_response_timeout = 120 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] run_external_periodic_tasks = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] scst_target_driver = iscsi {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] scst_target_iqn_name = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] service_down_time = 720 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] shell_completion = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] snapshot_name_template = snapshot-%s {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] split_loggers = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] state_path = /opt/stack/data/cinder {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] storage_availability_zone = nova {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] storage_protocol = iSCSI {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] syslog_log_facility = LOG_USER {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] target_helper = lioadm {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] target_ip_address = 192.168.122.29 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] target_port = 3260 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] target_protocol = iscsi {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] target_secondary_ip_addresses = [] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] trace_flags = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] transport_url = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] until_refresh = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] use_chap_auth = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] use_default_quota_class = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] use_journal = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] use_json = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] use_multipath_for_image_xfer = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] use_stderr = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] use_syslog = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] verify_glance_signatures = enabled {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] volume_api_class = cinder.volume.api.API {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] volume_backend_name = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] volume_clear = zero {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] volume_clear_ionice = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] volume_clear_size = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] volume_copy_bps_limit = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] volume_dd_blocksize = 1M {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] volume_name_template = volume-%s {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] volume_service_inithost_offload = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] volume_usage_audit_period = month {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] zoning_mode = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_concurrency.disable_process_locking = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.admin_password = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.admin_token = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.admin_user = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.auth_admin_prefix = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.auth_port = 35357 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.auth_protocol = https {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.auth_section = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.auth_type = password {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.auth_uri = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.auth_version = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.cache = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.certfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.identity_uri = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.include_service_catalog = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.insecure = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.interface = public {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.keyfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_password = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcache_username = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.region_name = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.service_token_roles_required = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.service_type = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.29/identity {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.backend = dogpile.cache.null {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.backend_argument = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.backend_expiration_time = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.config_prefix = cache.oslo {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.debug_cache_backend = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.enable_retry_client = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.enable_socket_keepalive = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.enabled = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.enforce_fips_mode = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.expiration_time = 600 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.hashclient_retry_attempts = 2 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.memcache_dead_retry = 300 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.memcache_pool_maxsize = 10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.memcache_sasl_enabled = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.password = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.proxies = [] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.redis_db = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.redis_server = localhost:6379 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.retry_attempts = 2 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.retry_delay = 0.0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.socket_keepalive_count = 1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.socket_keepalive_idle = 1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.socket_keepalive_interval = 1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.socket_timeout = 1.0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.tls_allowed_ciphers = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.tls_cafile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.tls_certfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.tls_enabled = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.tls_keyfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cache.username = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] coordination.backend_url = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.asyncio_connection = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.asyncio_slave_connection = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.backend = sqlalchemy {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.connection = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.connection_debug = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.connection_parameters = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.connection_recycle_time = 3600 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.connection_trace = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.db_inc_retry_interval = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.db_max_retries = 20 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.db_max_retry_interval = 10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.db_retry_interval = 1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.max_overflow = 50 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.max_pool_size = 5 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.max_retries = 10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.mysql_wsrep_sync_wait = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.pool_timeout = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.retry_interval = 10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.slave_connection = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.sqlite_synchronous = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.synchronous_reader = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] database.use_db_reconnect = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] profiler.connection_string = messaging:// {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] profiler.enabled = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] profiler.es_doc_type = notification {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] profiler.es_scroll_size = 10000 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] profiler.es_scroll_time = 2m {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] profiler.filter_error_trace = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] profiler.hmac_keys = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] profiler.sentinel_service_name = mymaster {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] profiler.socket_timeout = 0.1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] profiler.trace_requests = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] profiler.trace_sqlalchemy = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] profiler_jaeger.process_tags = {} {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] profiler_jaeger.service_name_prefix = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] profiler_otlp.service_name_prefix = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_policy.enforce_new_defaults = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: WARNING oslo_config.cfg [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_policy.enforce_scope = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_policy.policy_default_rule = default {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_policy.policy_file = policy.yaml {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] privsep_osbrick.group = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] privsep_osbrick.helper_command = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] privsep_osbrick.user = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cinder_sys_admin.group = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cinder_sys_admin.helper_command = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] cinder_sys_admin.user = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] service_user.auth_section = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] service_user.auth_type = password {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] service_user.cafile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86649) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] service_user.certfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] service_user.collect_timing = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.quobyte [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] service_user.insecure = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.quobyte [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] service_user.keyfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] service_user.send_service_user_token = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] service_user.split_loggers = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] service_user.timeout = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Running cmd (subprocess): mount.quobyte {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance.auth_section = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance.auth_type = password {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance.certfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance.collect_timing = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance.insecure = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance.keyfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance.region_name = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance.split_loggers = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] glance.timeout = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.backend_availability_zone = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.chap_password = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.chap_username = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.disk_geometry = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.driver_client_cert = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.driver_client_cert_key = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.driver_data_namespace = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.driver_use_ssl = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.extra_capabilities = {} {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.filter_function = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.goodness_function = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.iscsi_target_flags = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.iscsi_write_cache = on {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.iser_helper = tgtadm {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.iser_ip_address = 192.168.122.29 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.iser_port = 3260 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.nas_host = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.nas_login = admin {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.nas_mount_options = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.nas_password = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.nas_private_key = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.nas_share_path = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.num_shell_tries = 3 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.quobyte_volume_url = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.replication_device = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.report_discard_supported = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.reserved_percentage = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.target_helper = tgtadm {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.target_ip_address = 192.168.122.29 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.target_port = 3260 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.target_protocol = iscsi {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.trace_flags = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.unique_fqdn_network = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.use_chap_auth = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.volume_backend_name = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.volume_clear = zero {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.volume_clear_ionice = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.volume_clear_size = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_reports.file_event_handler = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_reports.log_dir = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.backend_availability_zone = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.backend_host = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.chap_password = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.chap_username = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.chiscsi_conf = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.disk_geometry = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.driver_client_cert = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.driver_data_namespace = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.driver_use_ssl = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.extra_capabilities = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.filter_function = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.goodness_function = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.iser_helper = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.iser_ip_address = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.iser_port = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.iser_target_prefix = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.nas_host = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.nas_login = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.nas_mount_options = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.nas_password = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.nas_private_key = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.nas_share_path = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.nas_ssh_port = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.num_shell_tries = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.nvmet_port_id = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.replication_device = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.report_discard_supported = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.reserved_percentage = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.scst_target_driver = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.storage_protocol = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.target_helper = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack quobyte-client[86650]: Reading configuration file: /etc/quobyte/client.cfg Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.target_ip_address = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.target_port = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.target_prefix = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.target_protocol = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack quobyte-client[86650]: Invalid parameters found, error: missing mount point. Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.trace_flags = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.use_chap_auth = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.volume_clear = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack quobyte-client[86650]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 01 09:26:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:26:13 devstack quobyte-client[86650]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.volume_clear_size = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] QuobyteHD.volumes_dir = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.ssl = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_notifications.driver = [] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_notifications.retry = -1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] key_manager.fixed_key = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.barbican_api_version = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.barbican_endpoint = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.barbican_endpoint_type = public {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.barbican_region_name = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.cafile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.certfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.collect_timing = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.insecure = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.keyfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.number_of_retries = 60 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.retry_delay = 1 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.send_service_user_token = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.split_loggers = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.timeout = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.verify_ssl = True {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican.verify_ssl_path = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican_service_user.auth_section = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican_service_user.auth_type = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican_service_user.cafile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican_service_user.certfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican_service_user.collect_timing = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican_service_user.insecure = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican_service_user.keyfile = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican_service_user.split_loggers = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] barbican_service_user.timeout = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] vault.approle_role_id = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] vault.approle_secret_id = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] vault.kv_mountpoint = secret {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] vault.kv_path = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] vault.kv_version = 2 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] vault.namespace = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] vault.root_token_id = **** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] vault.ssl_ca_crt_file = None {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] vault.timeout = 60.0 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] vault.use_ssl = False {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 01 09:26:13 devstack cinder-volume[86387]: DEBUG oslo_service.backend._eventlet.service [None req-3c48c8b3-56b1-4ce2-8a78-34b87337a830 None None] ******************************************************************************** {{(pid=86387) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 01 09:26:13 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:26:13 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:26:14 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.618s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:26:14 devstack cinder-volume[86649]: INFO cinder.volume.driver [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Driver hasn't implemented _init_vendor_properties() Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG cinder.volume.driver [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86649) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG oslo_db.sqlalchemy.engines [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86649) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writer thread running {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG cinder.db.sqlalchemy.api [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Building query based on filter {{(pid=86649) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86649) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:26:14 devstack cinder-volume[86649]: INFO cinder.keymgr.migration [None req-c0b75d72-1a13-4e5a-bc9b-5ec48d7c967a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 01 09:26:14 devstack sudo[86686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:26:14 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:26:14 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.588s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:26:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Driver initialization completed successfully. Jun 01 09:26:14 devstack cinder-volume[86649]: INFO cinder.manager [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Initiating service 3 cleanup Jun 01 09:26:14 devstack cinder-volume[86649]: INFO cinder.manager [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Service 3 cleanup completed. Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG cinder.service [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Creating RPC server for service cinder-volume {{(pid=86649) start /opt/stack/cinder/cinder/service.py:231}} Jun 01 09:26:14 devstack cinder-volume[86649]: DEBUG cinder.service [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86649) start /opt/stack/cinder/cinder/service.py:237}} Jun 01 09:26:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 01 09:26:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:26:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:26:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:26:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:26:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:26:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:26:15 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:26:15 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:26:15 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Jun 01 09:26:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.629s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:26:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fd6d5121-c6b9-4fa7-800e-d39ce1693553 None None] Driver post RPC initialization completed successfully. Jun 01 09:26:23 devstack cinder-volume[86387]: DEBUG dbcounter [-] [86387] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:26:24 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:26:25 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:27:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:27:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:27:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:27:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:27:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:27:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:27:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:27:36 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:27:36 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:27:38 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Jun 01 09:27:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.986s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:27:38 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:27:39 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:27:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Flow 'volume_create_manager' (d0dc808b-2a37-4b02-9c47-9cda9ba50872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:27:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b86bc9f-da54-4e96-adb3-0e20827810f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b86bc9f-da54-4e96-adb3-0e20827810f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1419000894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c120f83-f241-488c-b3f5-36a1a378d44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ceff7a66314dac948c0100a2a83067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:27:40Z,use_quota=True,user_id='51b34af6211c4692b6eafaa72c024cd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67b8050-187f-4d98-917a-a53d2619ffcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67b8050-187f-4d98-917a-a53d2619ffcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17076359-39e8-4ad3-81e2-395e64d481b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17076359-39e8-4ad3-81e2-395e64d481b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c120f83-f241-488c-b3f5-36a1a378d44a', 'volume_name': 'volume-9c120f83-f241-488c-b3f5-36a1a378d44a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71aa8aa5-5c4f-4520-a833-ca4b3d683467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71aa8aa5-5c4f-4520-a833-ca4b3d683467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c629d9-614b-497b-bee0-9ed22bcb68f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:27:40 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Volume 9c120f83-f241-488c-b3f5-36a1a378d44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c120f83-f241-488c-b3f5-36a1a378d44a', 'volume_size': 1} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1419000894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c120f83-f241-488c-b3f5-36a1a378d44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ceff7a66314dac948c0100a2a83067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:27:40Z,use_quota=True,user_id='51b34af6211c4692b6eafaa72c024cd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Creating volume 9c120f83-f241-488c-b3f5-36a1a378d44a {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:27:40 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:27:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c120f83-f241-488c-b3f5-36a1a378d44a 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:27:40 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c120f83-f241-488c-b3f5-36a1a378d44a 1073741824 Jun 01 09:27:40 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:27:42 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Jun 01 09:27:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c120f83-f241-488c-b3f5-36a1a378d44a 1073741824" returned: 0 in 2.038s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:27:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c120f83-f241-488c-b3f5-36a1a378d44a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:27:42 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c120f83-f241-488c-b3f5-36a1a378d44a Jun 01 09:27:42 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:27:43 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Jun 01 09:27:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c120f83-f241-488c-b3f5-36a1a378d44a" returned: 0 in 1.690s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:27:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] <== create_volume: return (3845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:27:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.847s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:27:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c629d9-614b-497b-bee0-9ed22bcb68f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c120f83-f241-488c-b3f5-36a1a378d44a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:27:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4972ef04-c5dd-4dd3-ade8-5a9e696bfc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:27:44 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Volume volume-9c120f83-f241-488c-b3f5-36a1a378d44a (9c120f83-f241-488c-b3f5-36a1a378d44a): created successfully Jun 01 09:27:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4972ef04-c5dd-4dd3-ade8-5a9e696bfc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:27:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Flow 'volume_create_manager' (d0dc808b-2a37-4b02-9c47-9cda9ba50872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:27:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7018b9cb-9916-4b7a-9e39-788b9001c654 tempest-VolumesAdminNegativeTest-919012449 None] Created volume successfully. Jun 01 09:27:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Acquiring lock "cinder-9c120f83-f241-488c-b3f5-36a1a378d44a-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:27:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Lock "cinder-9c120f83-f241-488c-b3f5-36a1a378d44a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:27:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Acquiring lock "cinder-quobyte-9c120f83-f241-488c-b3f5-36a1a378d44a" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:27:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Lock "cinder-quobyte-9c120f83-f241-488c-b3f5-36a1a378d44a" acquired by "delete_volume" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:27:45 devstack cinder-volume[86649]: INFO oslo.privsep.daemon [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2aj1ggve/privsep.sock'] Jun 01 09:27:45 devstack sudo[87543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2aj1ggve/privsep.sock Jun 01 09:27:45 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:27:48 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root Jun 01 09:27:48 devstack cinder-volume[86649]: INFO oslo.privsep.daemon [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Spawned new privsep daemon via rootwrap Jun 01 09:27:48 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Accepted privsep connection to /tmp/tmp2aj1ggve/privsep.sock {{(pid=86649) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 01 09:27:48 devstack cinder-volume[86649]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 01 09:27:48 devstack cinder-volume[86649]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 01 09:27:48 devstack cinder-volume[86649]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 01 09:27:48 devstack cinder-volume[86649]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87550 Jun 01 09:27:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b72b6f-eeeb-4940-9c0a-8ad57c81c34f]: (2,) {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:27:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad263dff-a1e6-4cf0-a260-055768b9a39b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:27:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c120f83-f241-488c-b3f5-36a1a378d44a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:27:49 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c120f83-f241-488c-b3f5-36a1a378d44a Jun 01 09:27:49 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:27:50 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Jun 01 09:27:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c120f83-f241-488c-b3f5-36a1a378d44a" returned: 0 in 1.530s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:27:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c120f83-f241-488c-b3f5-36a1a378d44a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:27:50 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c120f83-f241-488c-b3f5-36a1a378d44a Jun 01 09:27:50 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:27:52 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Jun 01 09:27:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c120f83-f241-488c-b3f5-36a1a378d44a" returned: 0 in 1.491s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:27:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Lock "cinder-quobyte-9c120f83-f241-488c-b3f5-36a1a378d44a" released by "delete_volume" :: held 6.303s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:27:52 devstack cinder-volume[86649]: WARNING cinder.quota [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:27:52 devstack cinder-volume[86649]: WARNING cinder.quota [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:27:52 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Created reservations ['701a9743-644f-455d-bb5c-1038b7ae02e2', 'a0c05318-6dd2-4982-aa42-aae84a5d0fed', '61beacc2-eb5d-4202-8cb6-d31798497ede', '3624258d-3815-4519-8751-2020c8c769de'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:27:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:27:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:27:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:27:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:27:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:27:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:27:52 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:27:52 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:27:53 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Jun 01 09:27:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.124s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:27:53 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Deleted volume successfully. Jun 01 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-06eb9c87-4281-436a-98df-36133a202dc5 tempest-VolumesAdminNegativeTest-919012449 None] Lock "cinder-9c120f83-f241-488c-b3f5-36a1a378d44a-delete_volume" released by "delete_volume" :: held 8.026s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:27:57 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:27:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Flow 'volume_create_manager' (72abd60d-1c33-46b6-8761-44526bbe05ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:27:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7656187a-16f8-4039-b4bc-8b16184a798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7656187a-16f8-4039-b4bc-8b16184a798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1065447565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f32b68e734434a349cbe4d9639d99132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:27:58Z,use_quota=True,user_id='d600452480cc43d3980b6d397e94ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb326819-b5d7-4de1-b07e-f5f5820fbf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb326819-b5d7-4de1-b07e-f5f5820fbf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8786e7f7-d776-4eab-ac7d-9b9a528886e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8786e7f7-d776-4eab-ac7d-9b9a528886e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2', 'volume_name': 'volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e04d378-d8c6-45a1-98f4-9e2ef96ac72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e04d378-d8c6-45a1-98f4-9e2ef96ac72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d64c322-f1cf-49e0-bcb0-ffc16e83a95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:27:58 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Volume e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2', 'volume_size': 1} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1065447565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f32b68e734434a349cbe4d9639d99132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:27:58Z,use_quota=True,user_id='d600452480cc43d3980b6d397e94ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Creating volume e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:27:58 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:27:58 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2 1073741824 Jun 01 09:27:58 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:27:58 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2 1073741824" returned: 0 in 0.866s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:27:58 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2 Jun 01 09:27:58 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:27:59 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Jun 01 09:27:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2" returned: 0 in 0.622s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:27:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:27:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:27:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d64c322-f1cf-49e0-bcb0-ffc16e83a95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:27:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9722fd1d-3712-4f0d-9075-de9e9e29f656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:27:59 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Volume volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2 (e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2): created successfully Jun 01 09:27:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9722fd1d-3712-4f0d-9075-de9e9e29f656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:27:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Flow 'volume_create_manager' (72abd60d-1c33-46b6-8761-44526bbe05ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:27:59 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-32adc6b1-583f-4e42-9e16-4ba663a68c6b tempest-ServersNegativeTestJSON-1750679750 None] Created volume successfully. Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Flow 'volume_create_manager' (80dc587a-47e8-4144-a764-8546d2f4b75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab31179-c7b2-4ee3-b1c6-322e60e6833a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab31179-c7b2-4ee3-b1c6-322e60e6833a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-760297068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b214b84-2bb2-4f51-8579-ad518a0b7eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f32b68e734434a349cbe4d9639d99132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:28:02Z,use_quota=True,user_id='d600452480cc43d3980b6d397e94ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892c7a18-9cc9-40f8-bacc-b3d8372b7a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892c7a18-9cc9-40f8-bacc-b3d8372b7a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1923b6c-b73d-4f80-8683-bd80e364f673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1923b6c-b73d-4f80-8683-bd80e364f673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b214b84-2bb2-4f51-8579-ad518a0b7eea', 'volume_name': 'volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427b5386-ea75-4b9c-a619-26cc900a285f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427b5386-ea75-4b9c-a619-26cc900a285f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a738fb9-b6b6-410f-9307-65241a1b9b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:02 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Volume 2b214b84-2bb2-4f51-8579-ad518a0b7eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea', 'volume_size': 1} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-760297068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b214b84-2bb2-4f51-8579-ad518a0b7eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f32b68e734434a349cbe4d9639d99132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:28:02Z,use_quota=True,user_id='d600452480cc43d3980b6d397e94ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Creating volume 2b214b84-2bb2-4f51-8579-ad518a0b7eea {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:28:02 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:28:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:02 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea 1073741824 Jun 01 09:28:02 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:03 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea 1073741824" returned: 0 in 0.926s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:03 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea Jun 01 09:28:03 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:04 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea" returned: 0 in 1.119s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] <== create_volume: return (2109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:28:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a738fb9-b6b6-410f-9307-65241a1b9b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4c01ba-77ae-4792-9f1a-6161fcd00c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:04 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Volume volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea (2b214b84-2bb2-4f51-8579-ad518a0b7eea): created successfully Jun 01 09:28:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4c01ba-77ae-4792-9f1a-6161fcd00c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Flow 'volume_create_manager' (80dc587a-47e8-4144-a764-8546d2f4b75f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:28:04 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-600e9668-4db3-4c66-9e9f-42cd70daf709 tempest-ServersNegativeTestJSON-1750679750 None] Created volume successfully. Jun 01 09:28:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Acquiring lock "cinder-2b214b84-2bb2-4f51-8579-ad518a0b7eea-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:28:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Lock "cinder-2b214b84-2bb2-4f51-8579-ad518a0b7eea-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:28:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Acquiring lock "cinder-quobyte-2b214b84-2bb2-4f51-8579-ad518a0b7eea" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:28:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Lock "cinder-quobyte-2b214b84-2bb2-4f51-8579-ad518a0b7eea" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:28:06 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fdde86-2bc4-4cba-947e-6eb49392d22f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:28:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:06 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea Jun 01 09:28:06 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:06 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea" returned: 0 in 0.782s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:06 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea Jun 01 09:28:06 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:07 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b214b84-2bb2-4f51-8579-ad518a0b7eea" returned: 0 in 0.612s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Lock "cinder-quobyte-2b214b84-2bb2-4f51-8579-ad518a0b7eea" released by "delete_volume" :: held 1.476s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:28:07 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Created reservations ['d52255ce-5fd4-405a-ad8a-ec10816fb671', 'af02568b-50c5-4787-894c-b9b9cd1a03a5', 'ed10c4b1-3691-4c8f-9dd1-c13add252215', 'fb8b4052-b9b3-4c38-8742-1121033f8e7d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:28:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:28:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:28:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:07 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:28:07 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Acquiring lock "cinder-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:28:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Lock "cinder-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:28:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Acquiring lock "cinder-quobyte-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:28:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Lock "cinder-quobyte-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2" acquired by "delete_volume" :: waited 0.050s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:28:08 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a052a62-bc74-4bc7-88fb-036aeef1c943]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:28:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:08 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.762s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:08 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:28:08 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Deleted volume successfully. Jun 01 09:28:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7529c7e4-0eb7-4180-93a2-944e6efa403d tempest-ServersNegativeTestJSON-1750679750 None] Lock "cinder-2b214b84-2bb2-4f51-8579-ad518a0b7eea-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:28:08 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2 Jun 01 09:28:08 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:09 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2" returned: 0 in 0.846s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:09 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2 Jun 01 09:28:09 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:09 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2" returned: 0 in 0.782s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Lock "cinder-quobyte-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2" released by "delete_volume" :: held 1.696s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:28:10 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Created reservations ['7129cd17-21c2-4517-a78b-55c475c741fb', 'dff4b6aa-bf7f-4ed8-9ead-fc991c3fe534', '0d2c2a8e-0708-43b2-8668-97284313e4bb', 'e5854ee7-43b9-48bb-a344-110f60f44248'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:28:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:28:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:28:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:10 devstack sudo[87741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:28:10 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:10 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.717s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:10 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:28:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Deleted volume successfully. Jun 01 09:28:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-11c47e7c-bf62-4837-9269-086270f6d159 tempest-ServersNegativeTestJSON-1750679750 None] Lock "cinder-e353972f-c91e-4ddd-b8c5-19bc6dcbc5c2-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Flow 'volume_create_manager' (4af21cc2-5d3e-4295-99d5-2c2d979685c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1688ce51-470f-443e-bd35-c342e076f46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1688ce51-470f-443e-bd35-c342e076f46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-114490622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457995a5-7890-4b98-a270-feedd33df523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2589568318b94a68b39397efedadc7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:28:16Z,use_quota=True,user_id='b262a446c5f5499f858d649b6a9ef6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94d84ad-dca8-4512-b8b3-6751c1b7dc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94d84ad-dca8-4512-b8b3-6751c1b7dc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ddd012-605e-4ec6-bb12-32b88d6a7b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ddd012-605e-4ec6-bb12-32b88d6a7b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '457995a5-7890-4b98-a270-feedd33df523', 'volume_name': 'volume-457995a5-7890-4b98-a270-feedd33df523', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0015794f-850b-4b59-9b0f-bb22f40e8559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0015794f-850b-4b59-9b0f-bb22f40e8559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d95d0d-e28d-43d1-9dbb-67cf944b9d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:15 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Volume 457995a5-7890-4b98-a270-feedd33df523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-457995a5-7890-4b98-a270-feedd33df523', 'volume_size': 1} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-114490622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457995a5-7890-4b98-a270-feedd33df523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2589568318b94a68b39397efedadc7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:28:16Z,use_quota=True,user_id='b262a446c5f5499f858d649b6a9ef6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Creating volume 457995a5-7890-4b98-a270-feedd33df523 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:28:15 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:28:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:15 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523 1073741824 Jun 01 09:28:15 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:16 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523 1073741824" returned: 0 in 1.020s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:16 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523 Jun 01 09:28:16 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:18 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523" returned: 0 in 1.260s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] <== create_volume: return (2340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:28:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.345s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d95d0d-e28d-43d1-9dbb-67cf944b9d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-457995a5-7890-4b98-a270-feedd33df523', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8973b8d7-b8e4-4792-a599-ddd236defe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:18 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Volume volume-457995a5-7890-4b98-a270-feedd33df523 (457995a5-7890-4b98-a270-feedd33df523): created successfully Jun 01 09:28:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8973b8d7-b8e4-4792-a599-ddd236defe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Flow 'volume_create_manager' (4af21cc2-5d3e-4295-99d5-2c2d979685c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:28:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8abc4bfb-3100-4619-b5ff-c334fa2afcf4 tempest-ServerActionsTestOtherA-2033220616 None] Created volume successfully. Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Flow 'volume_create_manager' (29e6fb88-fee5-4636-94cd-d0cf1b7f5ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b565ab-499f-4233-b42a-c390de5bf50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b565ab-499f-4233-b42a-c390de5bf50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-185664828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf3dd4b-f808-4356-8270-8a644c5e3fdf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62b37c008ad447f0a0f4f7ac32769fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:28:21Z,use_quota=True,user_id='477cde9dce454d2b97cfc6792c947d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb667862-0f3f-4b09-b209-aacb7f8ffeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb667862-0f3f-4b09-b209-aacb7f8ffeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2240e062-bce8-47bd-b93a-e33a3f7bba55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2240e062-bce8-47bd-b93a-e33a3f7bba55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acf3dd4b-f808-4356-8270-8a644c5e3fdf', 'volume_name': 'volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77adfb11-9e76-4849-8f38-73a3f51975c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77adfb11-9e76-4849-8f38-73a3f51975c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c86ed62-cba4-475f-b837-67e582e4b2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:20 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Volume acf3dd4b-f808-4356-8270-8a644c5e3fdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf', 'volume_size': 1} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-185664828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf3dd4b-f808-4356-8270-8a644c5e3fdf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62b37c008ad447f0a0f4f7ac32769fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:28:21Z,use_quota=True,user_id='477cde9dce454d2b97cfc6792c947d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Creating volume acf3dd4b-f808-4356-8270-8a644c5e3fdf {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:28:20 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:28:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:21 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf 1073741824 Jun 01 09:28:21 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Flow 'volume_create_manager' (f676f7ed-8ae4-46e4-883d-c2a0262e3f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31aa73a-594b-4be7-802b-3cd90e4a6602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31aa73a-594b-4be7-802b-3cd90e4a6602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1225278144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10767e86-7a53-4fe4-a7dd-0569ea5bca3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='899840733d0c431487dce9485a6f21bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:28:21Z,use_quota=True,user_id='983cead21423472eb563b42370e75565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318f8b64-98b3-4828-a89d-332aa5b7ab87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318f8b64-98b3-4828-a89d-332aa5b7ab87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559c7f34-2b07-4ddd-b3d4-535751e7259b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559c7f34-2b07-4ddd-b3d4-535751e7259b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10767e86-7a53-4fe4-a7dd-0569ea5bca3e', 'volume_name': 'volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0b0353-59f0-4fe9-8224-88bc0752bc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0b0353-59f0-4fe9-8224-88bc0752bc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694b72a4-9e1a-40e7-8be9-8da8a2543277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:21 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Volume 10767e86-7a53-4fe4-a7dd-0569ea5bca3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e', 'volume_size': 1} Jun 01 09:28:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:21 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf 1073741824" returned: 0 in 1.007s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:22 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf Jun 01 09:28:22 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:22 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf" returned: 0 in 0.659s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.334s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1225278144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10767e86-7a53-4fe4-a7dd-0569ea5bca3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='899840733d0c431487dce9485a6f21bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:28:21Z,use_quota=True,user_id='983cead21423472eb563b42370e75565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Creating volume 10767e86-7a53-4fe4-a7dd-0569ea5bca3e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:28:22 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c86ed62-cba4-475f-b837-67e582e4b2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:22 devstack sudo[87905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e 1073741824 Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114b2a3d-8c90-4169-a3f7-2030717a84f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:22 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:22 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Volume volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf (acf3dd4b-f808-4356-8270-8a644c5e3fdf): created successfully Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114b2a3d-8c90-4169-a3f7-2030717a84f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Flow 'volume_create_manager' (29e6fb88-fee5-4636-94cd-d0cf1b7f5ec9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:28:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-e04451cc-a4ba-400c-9ac2-3dfe580d2b02 req-5ece2a70-43b7-4a7b-9235-1152c8b2fd30 tempest-VolumesGetTestJSON-626768172 None] Created volume successfully. Jun 01 09:28:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Acquiring lock "cinder-acf3dd4b-f808-4356-8270-8a644c5e3fdf-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:28:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Lock "cinder-acf3dd4b-f808-4356-8270-8a644c5e3fdf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:28:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Acquiring lock "cinder-quobyte-acf3dd4b-f808-4356-8270-8a644c5e3fdf" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:28:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Lock "cinder-quobyte-acf3dd4b-f808-4356-8270-8a644c5e3fdf" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:28:23 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed78f0f-ce3f-49f7-9281-b4706d807285]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:28:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:23 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf Jun 01 09:28:23 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:23 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e 1073741824" returned: 0 in 1.138s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:23 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e Jun 01 09:28:23 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:24 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf" returned: 0 in 1.213s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:24 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf Jun 01 09:28:24 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:24 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e" returned: 0 in 1.049s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] <== create_volume: return (2273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:28:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.280s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694b72a4-9e1a-40e7-8be9-8da8a2543277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6030c704-e33f-4158-a715-fb60d7a1b1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:25 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Volume volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e (10767e86-7a53-4fe4-a7dd-0569ea5bca3e): created successfully Jun 01 09:28:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6030c704-e33f-4158-a715-fb60d7a1b1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Flow 'volume_create_manager' (f676f7ed-8ae4-46e4-883d-c2a0262e3f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:28:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0aeba009-9a70-4d35-9898-8408ff379fda tempest-DeleteServersTestJSON-1532018338 None] Created volume successfully. Jun 01 09:28:25 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-acf3dd4b-f808-4356-8270-8a644c5e3fdf" returned: 0 in 0.780s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Lock "cinder-quobyte-acf3dd4b-f808-4356-8270-8a644c5e3fdf" released by "delete_volume" :: held 2.065s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:28:25 devstack cinder-volume[86649]: DEBUG cinder.quota [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Created reservations ['b2ad434d-15ee-45eb-93f8-3649cda3462d', '154bb04f-3296-4d4c-9489-f90c3b517ae2', '140c331c-d9ff-413a-857b-3ceb612bdcbc', '1c8841dc-0671-4eb4-9f4b-61a516b645d1'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:28:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:28:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:28:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:25 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:28:25 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:27 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.306s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:27 devstack cinder-volume[86649]: DEBUG cinder.manager [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:28:27 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Deleted volume successfully. Jun 01 09:28:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-460aeb2c-54d2-481b-ba66-361f6a6d3c0d req-be95ea92-9313-4790-acf1-0d6b77801a92 tempest-VolumesGetTestJSON-626768172 None] Lock "cinder-acf3dd4b-f808-4356-8270-8a644c5e3fdf-delete_volume" released by "delete_volume" :: held 3.759s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:28:32 devstack cinder-volume[86649]: WARNING py.warnings [req-2f444c96-5c48-4fa0-bf47-339d058cfdc4 req-0c4e9f4d-65fc-42be-a63b-52fa11b5aef4 tempest-DeleteServersTestJSON-1532018338 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jun 01 09:28:32 devstack cinder-volume[86649]: .first() Jun 01 09:28:32 devstack cinder-volume[86649]: Jun 01 09:28:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-2f444c96-5c48-4fa0-bf47-339d058cfdc4 req-0c4e9f4d-65fc-42be-a63b-52fa11b5aef4 tempest-DeleteServersTestJSON-1532018338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-2f444c96-5c48-4fa0-bf47-339d058cfdc4 req-0c4e9f4d-65fc-42be-a63b-52fa11b5aef4 tempest-DeleteServersTestJSON-1532018338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[51960fe1-00e2-4a0f-9338-38fffa554fcc]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:28:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-2f444c96-5c48-4fa0-bf47-339d058cfdc4 req-0c4e9f4d-65fc-42be-a63b-52fa11b5aef4 tempest-DeleteServersTestJSON-1532018338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:32 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e Jun 01 09:28:32 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-aa41e787-e450-4886-9497-baa928d9e520 tempest-GroupSnapshotsV319Test-1904847100 None] Group tempest-GroupSnapshotsV319Test-Group-39601085: creating Jun 01 09:28:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-aa41e787-e450-4886-9497-baa928d9e520 tempest-GroupSnapshotsV319Test-1904847100 None] Group tempest-GroupSnapshotsV319Test-Group-39601085: created successfully Jun 01 09:28:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-aa41e787-e450-4886-9497-baa928d9e520 tempest-GroupSnapshotsV319Test-1904847100 None] Create group completed successfully. Jun 01 09:28:32 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-2f444c96-5c48-4fa0-bf47-339d058cfdc4 req-0c4e9f4d-65fc-42be-a63b-52fa11b5aef4 tempest-DeleteServersTestJSON-1532018338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e" returned: 0 in 0.847s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-2f444c96-5c48-4fa0-bf47-339d058cfdc4 req-0c4e9f4d-65fc-42be-a63b-52fa11b5aef4 tempest-DeleteServersTestJSON-1532018338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.868s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-2f444c96-5c48-4fa0-bf47-339d058cfdc4 req-0c4e9f4d-65fc-42be-a63b-52fa11b5aef4 tempest-DeleteServersTestJSON-1532018338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e41bfc4-bfb1-4466-b12e-f938da3270e7', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:28:33 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-2f444c96-5c48-4fa0-bf47-339d058cfdc4 req-0c4e9f4d-65fc-42be-a63b-52fa11b5aef4 tempest-DeleteServersTestJSON-1532018338 None] attachment_update completed successfully. Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Flow 'volume_create_manager' (d8d68c0f-d02a-4c0f-9bc2-03d3157818be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a628fe75-59be-43e1-8b9d-34da648534c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a628fe75-59be-43e1-8b9d-34da648534c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-639013247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dc9946d-103e-48f7-a257-f881e8cb412f,host='devstack@QuobyteHD#QuobyteHD',id=386e16e9-c91e-486c-91bf-1e35ef50ecd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc05620220194dcd8239b496ebcbface',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:28:34Z,use_quota=True,user_id='ba55ee5f50b546f68c3dc52e40e06a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11c2e51d-b2af-46f0-9512-d44441682c55),volume_type_id=11c2e51d-b2af-46f0-9512-d44441682c55)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51910c71-0575-41f8-9d55-92b050716dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51910c71-0575-41f8-9d55-92b050716dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167467c0-fc93-4938-887c-69242ffe22a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167467c0-fc93-4938-887c-69242ffe22a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '386e16e9-c91e-486c-91bf-1e35ef50ecd1', 'volume_name': 'volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e71ecee7-e6eb-413b-800f-630c8ce90145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e71ecee7-e6eb-413b-800f-630c8ce90145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a205ba-4328-4731-a280-679ec448fd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:34 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Volume 386e16e9-c91e-486c-91bf-1e35ef50ecd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1', 'volume_size': 1} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2dc9946d-103e-48f7-a257-f881e8cb412f,created_at=2026-06-01T07:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-639013247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dc9946d-103e-48f7-a257-f881e8cb412f,host='devstack@QuobyteHD#QuobyteHD',id=386e16e9-c91e-486c-91bf-1e35ef50ecd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc05620220194dcd8239b496ebcbface',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:28:34Z,use_quota=True,user_id='ba55ee5f50b546f68c3dc52e40e06a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11c2e51d-b2af-46f0-9512-d44441682c55),volume_type_id=11c2e51d-b2af-46f0-9512-d44441682c55)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Creating volume 386e16e9-c91e-486c-91bf-1e35ef50ecd1 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:28:34 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:28:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:34 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 1073741824 Jun 01 09:28:34 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:35 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 1073741824" returned: 0 in 1.142s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:35 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=43,cinder:UPDATE=52,cinder:INSERT=11,cinder:DELETE=6 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:28:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:35 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 Jun 01 09:28:35 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:36 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1" returned: 0 in 0.989s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.333s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:36 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:28:36 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a205ba-4328-4731-a280-679ec448fd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062110a4-091e-4a3c-bd2b-4c310cce5bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=40,cinder:UPDATE=58,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:28:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Volume volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 (386e16e9-c91e-486c-91bf-1e35ef50ecd1): created successfully Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062110a4-091e-4a3c-bd2b-4c310cce5bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:28:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Flow 'volume_create_manager' (d8d68c0f-d02a-4c0f-9bc2-03d3157818be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:28:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b824ef2b-058c-45a9-bc34-63c24b586088 tempest-GroupSnapshotsV319Test-1904847100 None] Created volume successfully. Jun 01 09:28:37 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.950s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:28:38 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] GroupSnapshot 3f30fda6-c9cc-4864-b840-5812e1af7de8: creating. Jun 01 09:28:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] Group snapshot 3f30fda6-c9cc-4864-b840-5812e1af7de8: creating. {{(pid=86649) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 01 09:28:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] Creating offline snapshot c9e14506-b0b9-4c5f-aeba-f590f8c6a316 of volume 386e16e9-c91e-486c-91bf-1e35ef50ecd1 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:28:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8bf104-6d1b-4b5c-992e-460e08e00791]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:28:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:38 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 Jun 01 09:28:38 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:39 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1" returned: 0 in 1.159s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:39 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 1G Jun 01 09:28:39 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:41 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 1G" returned: 0 in 1.198s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:41 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 Jun 01 09:28:41 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:42 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316" returned: 0 in 1.072s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:42 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 is being set with open permissions: ugo+rw: NotImplementedError Jun 01 09:28:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:42 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 Jun 01 09:28:42 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:43 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316" returned: 0 in 1.079s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-bee18ab9-a1ad-42e1-849e-1c2b17eb520e req-6d1bc5cb-5c92-48a8-8a0d-60d834f2ac7f tempest-DeleteServersTestJSON-1532018338 None] Terminate volume connection completed successfully. Jun 01 09:28:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-bee18ab9-a1ad-42e1-849e-1c2b17eb520e req-6d1bc5cb-5c92-48a8-8a0d-60d834f2ac7f tempest-DeleteServersTestJSON-1532018338 None] Deleting attachment 2e41bfc4-bfb1-4466-b12e-f938da3270e7. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:28:43 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.info Jun 01 09:28:43 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:44 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.info" returned: 0 in 1.055s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:44 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.info is being set with open permissions: ugo+rw: NotImplementedError Jun 01 09:28:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:44 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.info Jun 01 09:28:44 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:45 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.info" returned: 0 in 0.962s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.686s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5c25f504-57fa-4fb5-abbc-2e93eaf75c4c tempest-GroupSnapshotsV319Test-1904847100 None] group_snapshot 3f30fda6-c9cc-4864-b840-5812e1af7de8: created successfully Jun 01 09:28:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] group_snapshot 3f30fda6-c9cc-4864-b840-5812e1af7de8: deleting Jun 01 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] group_snapshot 3f30fda6-c9cc-4864-b840-5812e1af7de8: deleting {{(pid=86649) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 01 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Acquiring lock "cinder-quobyte-386e16e9-c91e-486c-91bf-1e35ef50ecd1" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Lock "cinder-quobyte-386e16e9-c91e-486c-91bf-1e35ef50ecd1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Acquiring lock "cinder-quobyte-c9e14506-b0b9-4c5f-aeba-f590f8c6a316" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Lock "cinder-quobyte-c9e14506-b0b9-4c5f-aeba-f590f8c6a316" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Deleting offline snapshot c9e14506-b0b9-4c5f-aeba-f590f8c6a316 of volume 386e16e9-c91e-486c-91bf-1e35ef50ecd1 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] snapshot_file for this snap is: volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:28:47 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8689b195-4b30-405c-97c6-be2f713b3cbd]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:28:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:47 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 Jun 01 09:28:47 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Acquiring lock "cinder-10767e86-7a53-4fe4-a7dd-0569ea5bca3e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Lock "cinder-10767e86-7a53-4fe4-a7dd-0569ea5bca3e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:28:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Acquiring lock "cinder-quobyte-10767e86-7a53-4fe4-a7dd-0569ea5bca3e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:28:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Lock "cinder-quobyte-10767e86-7a53-4fe4-a7dd-0569ea5bca3e" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:28:48 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f760f89-1847-4868-8ac1-13ea664ee267]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:28:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:48 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e Jun 01 09:28:48 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:48 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316" returned: 0 in 0.812s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:28:48 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df9ad96-037b-48cc-88c3-469a85ee14aa]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:28:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:48 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 Jun 01 09:28:48 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:48 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e" returned: 0 in 0.781s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:48 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e Jun 01 09:28:48 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:48 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1" returned: 0 in 0.751s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:49 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 Jun 01 09:28:49 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:49 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10767e86-7a53-4fe4-a7dd-0569ea5bca3e" returned: 0 in 0.610s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Lock "cinder-quobyte-10767e86-7a53-4fe4-a7dd-0569ea5bca3e" released by "delete_volume" :: held 1.433s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:28:49 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Created reservations ['752f42e4-2829-4c37-b844-f7e0d4a273c8', '25f359ae-631b-4595-b25c-5ca3039b4f91', '0cd767fc-cde1-432d-b0da-5cfc611926cf', '5a0aa4a9-975b-44be-b7c8-ae049078e07c'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:28:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:28:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:28:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:49 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:28:49 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:49 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316" returned: 0 in 0.720s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:49 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316 Jun 01 09:28:49 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:50 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.600s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:50 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:28:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Deleted volume successfully. Jun 01 09:28:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-37153281-1953-4e42-9ec3-634f6accb700 tempest-DeleteServersTestJSON-1532018338 None] Lock "cinder-10767e86-7a53-4fe4-a7dd-0569ea5bca3e-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:28:50 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1.c9e14506-b0b9-4c5f-aeba-f590f8c6a316" returned: 0 in 0.618s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Lock "cinder-quobyte-c9e14506-b0b9-4c5f-aeba-f590f8c6a316" released by "_delete_snapshot" :: held 3.021s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:28:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Lock "cinder-quobyte-386e16e9-c91e-486c-91bf-1e35ef50ecd1" released by "delete_snapshot" :: held 3.053s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:28:50 devstack cinder-volume[86649]: WARNING cinder.quota [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1570905879 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1570905879, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:28:50 devstack cinder-volume[86649]: WARNING cinder.quota [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1570905879 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1570905879, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:28:50 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] Created reservations ['d7d5a8f8-2628-44b6-b0d3-cb761a0e9167', '6158db13-678d-40e8-bf5a-4863e980ea26', 'a55d07e5-daf2-404a-9b20-2f34cf4ad322', '1ade8892-fdc7-48d6-bc11-e75e56297737'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:28:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b9325863-bde5-4383-ac98-ddbf6b5d5521 tempest-GroupSnapshotsV319Test-1904847100 None] group_snapshot 3f30fda6-c9cc-4864-b840-5812e1af7de8: deleted successfully Jun 01 09:28:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Acquiring lock "cinder-quobyte-386e16e9-c91e-486c-91bf-1e35ef50ecd1" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:28:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Lock "cinder-quobyte-386e16e9-c91e-486c-91bf-1e35ef50ecd1" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:28:51 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c14d6b-7c56-4da2-aab6-9915e63f935a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:28:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:51 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 Jun 01 09:28:51 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:51 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1" returned: 0 in 0.756s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:51 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1 Jun 01 09:28:51 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:52 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-386e16e9-c91e-486c-91bf-1e35ef50ecd1" returned: 0 in 0.708s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Lock "cinder-quobyte-386e16e9-c91e-486c-91bf-1e35ef50ecd1" released by "delete_volume" :: held 1.553s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:28:52 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Created reservations ['579eed05-c439-4741-8369-b0a8700ebc84'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:28:52 devstack cinder-volume[86649]: WARNING cinder.quota [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1570905879 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1570905879, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:28:52 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Created reservations ['0ae88933-479a-42d6-814d-037161236cae', '2e7b97bf-9d1c-40fb-b09b-3c5b886b3839', '81d450e9-d65c-4f75-a65d-5181dcec8d58', 'da7cfb31-d8a6-4c63-a4be-887ffa1d2a39'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:28:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:28:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:28:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:28:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:28:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:28:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:28:52 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:28:52 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:28:53 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Jun 01 09:28:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.902s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:28:53 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:28:53 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5e71f908-bc9e-410c-acb2-4ff2fb72b177 tempest-GroupSnapshotsV319Test-1904847100 None] Delete group completed successfully. Jun 01 09:28:59 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b65473bb-54ac-4d7c-adaa-60c2346b01dc tempest-GroupsTest-220907046 None] Group tempest-Group1-102695397: creating Jun 01 09:28:59 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b65473bb-54ac-4d7c-adaa-60c2346b01dc tempest-GroupsTest-220907046 None] Group tempest-Group1-102695397: created successfully Jun 01 09:28:59 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b65473bb-54ac-4d7c-adaa-60c2346b01dc tempest-GroupsTest-220907046 None] Create group completed successfully. Jun 01 09:29:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-9da3b31f-8c9c-41a1-9822-e32c2b2db494 req-71ca5418-3035-4c89-8d68-75bc200ac8b3 tempest-ServerActionsTestOtherA-2033220616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-9da3b31f-8c9c-41a1-9822-e32c2b2db494 req-71ca5418-3035-4c89-8d68-75bc200ac8b3 tempest-ServerActionsTestOtherA-2033220616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:00 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[463095f0-c6ce-48d6-8036-8e023510a138]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:29:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-9da3b31f-8c9c-41a1-9822-e32c2b2db494 req-71ca5418-3035-4c89-8d68-75bc200ac8b3 tempest-ServerActionsTestOtherA-2033220616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:00 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523 Jun 01 09:29:00 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-115b4a69-c992-4dd4-b0dd-5e9a264b7432 tempest-GroupsTest-220907046 None] Group tempest-Group2-1264022231: creating Jun 01 09:29:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-115b4a69-c992-4dd4-b0dd-5e9a264b7432 tempest-GroupsTest-220907046 None] Group tempest-Group2-1264022231: created successfully Jun 01 09:29:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-115b4a69-c992-4dd4-b0dd-5e9a264b7432 tempest-GroupsTest-220907046 None] Create group completed successfully. Jun 01 09:29:01 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-9da3b31f-8c9c-41a1-9822-e32c2b2db494 req-71ca5418-3035-4c89-8d68-75bc200ac8b3 tempest-ServerActionsTestOtherA-2033220616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523" returned: 0 in 1.027s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-9da3b31f-8c9c-41a1-9822-e32c2b2db494 req-71ca5418-3035-4c89-8d68-75bc200ac8b3 tempest-ServerActionsTestOtherA-2033220616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.071s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-9da3b31f-8c9c-41a1-9822-e32c2b2db494 req-71ca5418-3035-4c89-8d68-75bc200ac8b3 tempest-ServerActionsTestOtherA-2033220616 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-457995a5-7890-4b98-a270-feedd33df523', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a416edb-7a5a-429e-8046-07cb61aa3d78', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:29:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-9da3b31f-8c9c-41a1-9822-e32c2b2db494 req-71ca5418-3035-4c89-8d68-75bc200ac8b3 tempest-ServerActionsTestOtherA-2033220616 None] attachment_update completed successfully. Jun 01 09:29:02 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Flow 'volume_create_manager' (e67e216d-64fd-40a9-a6b5-e7bc7b7b93d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4994b4a-7713-4aed-930e-495549c56f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4994b4a-7713-4aed-930e-495549c56f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1029201886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb1525de-0ec6-49de-b38f-e0cd21c76e7a,host='devstack@QuobyteHD#QuobyteHD',id=290bd79d-c137-462d-9565-757e01f71045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c6b6add54b40ac88c2df20b2b832c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:29:03Z,use_quota=True,user_id='e5a622f7cf7c4fb991d1825309c10c19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8c4877-516e-4f81-b7ad-bc9234e7bc6a),volume_type_id=bd8c4877-516e-4f81-b7ad-bc9234e7bc6a)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c678c9-7119-47fe-a865-cbdd24ec871c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c678c9-7119-47fe-a865-cbdd24ec871c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f21a686-c4b8-4175-bad1-b5016b2cd1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f21a686-c4b8-4175-bad1-b5016b2cd1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '290bd79d-c137-462d-9565-757e01f71045', 'volume_name': 'volume-290bd79d-c137-462d-9565-757e01f71045', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5704998-19ec-4ecf-958a-304534bec108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5704998-19ec-4ecf-958a-304534bec108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f566fd-0118-4e99-b9f1-59d3fd530d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:03 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Volume 290bd79d-c137-462d-9565-757e01f71045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-290bd79d-c137-462d-9565-757e01f71045', 'volume_size': 1} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fb1525de-0ec6-49de-b38f-e0cd21c76e7a,created_at=2026-06-01T07:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1029201886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb1525de-0ec6-49de-b38f-e0cd21c76e7a,host='devstack@QuobyteHD#QuobyteHD',id=290bd79d-c137-462d-9565-757e01f71045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c6b6add54b40ac88c2df20b2b832c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:29:03Z,use_quota=True,user_id='e5a622f7cf7c4fb991d1825309c10c19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8c4877-516e-4f81-b7ad-bc9234e7bc6a),volume_type_id=bd8c4877-516e-4f81-b7ad-bc9234e7bc6a)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Creating volume 290bd79d-c137-462d-9565-757e01f71045 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:29:03 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:29:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-290bd79d-c137-462d-9565-757e01f71045 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:03 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-290bd79d-c137-462d-9565-757e01f71045 1073741824 Jun 01 09:29:03 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:04 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-290bd79d-c137-462d-9565-757e01f71045 1073741824" returned: 0 in 1.235s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-290bd79d-c137-462d-9565-757e01f71045 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:04 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-290bd79d-c137-462d-9565-757e01f71045 Jun 01 09:29:04 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:05 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-290bd79d-c137-462d-9565-757e01f71045" returned: 0 in 1.168s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] <== create_volume: return (2484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:29:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.487s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f566fd-0118-4e99-b9f1-59d3fd530d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-290bd79d-c137-462d-9565-757e01f71045', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d44c05d-d9e3-4bed-91b5-62ad58422cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:05 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Volume volume-290bd79d-c137-462d-9565-757e01f71045 (290bd79d-c137-462d-9565-757e01f71045): created successfully Jun 01 09:29:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d44c05d-d9e3-4bed-91b5-62ad58422cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Flow 'volume_create_manager' (e67e216d-64fd-40a9-a6b5-e7bc7b7b93d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:29:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4b7854eb-5446-4eee-8d5f-89709800ae90 tempest-GroupsTest-220907046 None] Created volume successfully. Jun 01 09:29:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Acquiring lock "cinder-quobyte-290bd79d-c137-462d-9565-757e01f71045" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:29:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Lock "cinder-quobyte-290bd79d-c137-462d-9565-757e01f71045" acquired by "delete_volume" :: waited 0.041s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:29:07 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1093e7aa-6020-466d-bde2-0b64a481012d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:29:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-290bd79d-c137-462d-9565-757e01f71045 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:07 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-290bd79d-c137-462d-9565-757e01f71045 Jun 01 09:29:07 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:08 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-290bd79d-c137-462d-9565-757e01f71045" returned: 0 in 1.120s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-290bd79d-c137-462d-9565-757e01f71045 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:08 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-290bd79d-c137-462d-9565-757e01f71045 Jun 01 09:29:08 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:09 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-290bd79d-c137-462d-9565-757e01f71045" returned: 0 in 1.194s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Lock "cinder-quobyte-290bd79d-c137-462d-9565-757e01f71045" released by "delete_volume" :: held 2.402s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:29:10 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Created reservations ['9ac35e2c-3e1d-4ab5-a160-c61b8925e82d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:29:10 devstack cinder-volume[86649]: WARNING cinder.quota [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-367362482 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-367362482, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:29:10 devstack cinder-volume[86649]: WARNING cinder.quota [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-367362482 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-367362482, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:29:10 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Created reservations ['d4143644-3f11-4873-b8b4-f3531513280e', 'c586b5db-9af5-4bcd-bb2e-a54edc6f0b39', 'ac683433-97b7-428c-a116-fffb174ba166', 'fa59787d-968d-414f-beb2-7db1979d12f9'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:29:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:29:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:29:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:10 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:29:10 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:11 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.823s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:11 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:29:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a2072c55-d980-410d-9b21-ab6c1c44737b tempest-GroupsTest-220907046 None] Delete group completed successfully. Jun 01 09:29:11 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b42f4bbd-24ae-4e29-952a-c64bc0e65dcd tempest-GroupsTest-220907046 None] Created reservations ['e89d0c86-31f4-4d78-81a5-77be28aa15ea'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:29:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b42f4bbd-24ae-4e29-952a-c64bc0e65dcd tempest-GroupsTest-220907046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b42f4bbd-24ae-4e29-952a-c64bc0e65dcd tempest-GroupsTest-220907046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b42f4bbd-24ae-4e29-952a-c64bc0e65dcd tempest-GroupsTest-220907046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:29:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b42f4bbd-24ae-4e29-952a-c64bc0e65dcd tempest-GroupsTest-220907046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:29:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b42f4bbd-24ae-4e29-952a-c64bc0e65dcd tempest-GroupsTest-220907046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b42f4bbd-24ae-4e29-952a-c64bc0e65dcd tempest-GroupsTest-220907046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:11 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:29:11 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:12 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b42f4bbd-24ae-4e29-952a-c64bc0e65dcd tempest-GroupsTest-220907046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.077s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:12 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-b42f4bbd-24ae-4e29-952a-c64bc0e65dcd tempest-GroupsTest-220907046 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:29:12 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b42f4bbd-24ae-4e29-952a-c64bc0e65dcd tempest-GroupsTest-220907046 None] Delete group completed successfully. Jun 01 09:29:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-7193de05-8783-4269-b445-467d9f925921 req-baa0ec87-47a9-4821-9b8a-ef656e41d952 tempest-ServerActionsTestOtherA-2033220616 None] Terminate volume connection completed successfully. Jun 01 09:29:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-7193de05-8783-4269-b445-467d9f925921 req-baa0ec87-47a9-4821-9b8a-ef656e41d952 tempest-ServerActionsTestOtherA-2033220616 None] Deleting attachment 4a416edb-7a5a-429e-8046-07cb61aa3d78. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:29:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2a24a5e3-3140-47ce-84da-fb356c344537 tempest-GroupsTest-220907046 None] Group tempest-GroupsTest-Group-35757216: creating Jun 01 09:29:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2a24a5e3-3140-47ce-84da-fb356c344537 tempest-GroupsTest-220907046 None] Group tempest-GroupsTest-Group-35757216: created successfully Jun 01 09:29:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2a24a5e3-3140-47ce-84da-fb356c344537 tempest-GroupsTest-220907046 None] Create group completed successfully. Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Flow 'volume_create_manager' (807dd396-47c3-429f-bc7e-e4de55af3aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b231bca1-45f7-4866-95cb-cb8d96678264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b231bca1-45f7-4866-95cb-cb8d96678264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1923723926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6bc3bc64-47b5-426d-a306-2b92fc37b644,host='devstack@QuobyteHD#QuobyteHD',id=26e2a0df-4c24-42b3-ae23-088b749cce48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c6b6add54b40ac88c2df20b2b832c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:29:15Z,use_quota=True,user_id='e5a622f7cf7c4fb991d1825309c10c19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb05daf5-4a65-4aa2-a2a1-b7e2b682da82),volume_type_id=cb05daf5-4a65-4aa2-a2a1-b7e2b682da82)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96a86cf-0dc1-45d0-b0dd-e00916509529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96a86cf-0dc1-45d0-b0dd-e00916509529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c345755-8cd4-42ac-89a9-16bab7df7655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c345755-8cd4-42ac-89a9-16bab7df7655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e2a0df-4c24-42b3-ae23-088b749cce48', 'volume_name': 'volume-26e2a0df-4c24-42b3-ae23-088b749cce48', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4986960d-db54-48a2-887c-f9c35a3c2579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4986960d-db54-48a2-887c-f9c35a3c2579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee820ae-63f8-4db4-bcc2-0420f6e59f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:15 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Volume 26e2a0df-4c24-42b3-ae23-088b749cce48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e2a0df-4c24-42b3-ae23-088b749cce48', 'volume_size': 1} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6bc3bc64-47b5-426d-a306-2b92fc37b644,created_at=2026-06-01T07:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1923723926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6bc3bc64-47b5-426d-a306-2b92fc37b644,host='devstack@QuobyteHD#QuobyteHD',id=26e2a0df-4c24-42b3-ae23-088b749cce48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c6b6add54b40ac88c2df20b2b832c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:29:15Z,use_quota=True,user_id='e5a622f7cf7c4fb991d1825309c10c19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb05daf5-4a65-4aa2-a2a1-b7e2b682da82),volume_type_id=cb05daf5-4a65-4aa2-a2a1-b7e2b682da82)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Creating volume 26e2a0df-4c24-42b3-ae23-088b749cce48 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:29:15 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-26e2a0df-4c24-42b3-ae23-088b749cce48 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:15 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-26e2a0df-4c24-42b3-ae23-088b749cce48 1073741824 Jun 01 09:29:15 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-7193de05-8783-4269-b445-467d9f925921 req-7ec2bcc3-0391-4951-a8a4-b431d52329a1 tempest-ServerActionsTestOtherA-2033220616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:16 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-26e2a0df-4c24-42b3-ae23-088b749cce48 1073741824" returned: 0 in 0.966s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-26e2a0df-4c24-42b3-ae23-088b749cce48 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:16 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-26e2a0df-4c24-42b3-ae23-088b749cce48 Jun 01 09:29:16 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:16 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-26e2a0df-4c24-42b3-ae23-088b749cce48" returned: 0 in 0.602s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:29:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-7193de05-8783-4269-b445-467d9f925921 req-7ec2bcc3-0391-4951-a8a4-b431d52329a1 tempest-ServerActionsTestOtherA-2033220616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.067s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee820ae-63f8-4db4-bcc2-0420f6e59f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e2a0df-4c24-42b3-ae23-088b749cce48', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaaa1063-4990-4321-9af3-5bdccee01690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7260c1-2798-4e56-b013-22948d8d5492]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:29:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-7193de05-8783-4269-b445-467d9f925921 req-7ec2bcc3-0391-4951-a8a4-b431d52329a1 tempest-ServerActionsTestOtherA-2033220616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:16 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Volume volume-26e2a0df-4c24-42b3-ae23-088b749cce48 (26e2a0df-4c24-42b3-ae23-088b749cce48): created successfully Jun 01 09:29:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaaa1063-4990-4321-9af3-5bdccee01690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Flow 'volume_create_manager' (807dd396-47c3-429f-bc7e-e4de55af3aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:29:17 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2fae701e-9f91-4651-aa12-ac4422b0b68d tempest-GroupsTest-220907046 None] Created volume successfully. Jun 01 09:29:17 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523 Jun 01 09:29:17 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:17 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-7193de05-8783-4269-b445-467d9f925921 req-7ec2bcc3-0391-4951-a8a4-b431d52329a1 tempest-ServerActionsTestOtherA-2033220616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523" returned: 0 in 0.870s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-7193de05-8783-4269-b445-467d9f925921 req-7ec2bcc3-0391-4951-a8a4-b431d52329a1 tempest-ServerActionsTestOtherA-2033220616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.904s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-7193de05-8783-4269-b445-467d9f925921 req-7ec2bcc3-0391-4951-a8a4-b431d52329a1 tempest-ServerActionsTestOtherA-2033220616 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-457995a5-7890-4b98-a270-feedd33df523', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c16237d-4c28-406c-a781-3812b65d434f', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:29:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-7193de05-8783-4269-b445-467d9f925921 req-7ec2bcc3-0391-4951-a8a4-b431d52329a1 tempest-ServerActionsTestOtherA-2033220616 None] attachment_update completed successfully. Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Flow 'volume_create_manager' (c9bf9264-b149-4d8a-984c-e3f447dc4115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49330332-ada3-484b-8392-3796c313abc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49330332-ada3-484b-8392-3796c313abc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1920187546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6bc3bc64-47b5-426d-a306-2b92fc37b644,host='devstack@QuobyteHD#QuobyteHD',id=10300f11-fdb3-43dd-a202-f2239bd052d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c6b6add54b40ac88c2df20b2b832c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:29:18Z,use_quota=True,user_id='e5a622f7cf7c4fb991d1825309c10c19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb05daf5-4a65-4aa2-a2a1-b7e2b682da82),volume_type_id=cb05daf5-4a65-4aa2-a2a1-b7e2b682da82)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408a1604-b450-473d-8901-8f149c28b277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408a1604-b450-473d-8901-8f149c28b277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce16795-c7dd-4370-b23a-a5a3db67f3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce16795-c7dd-4370-b23a-a5a3db67f3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10300f11-fdb3-43dd-a202-f2239bd052d8', 'volume_name': 'volume-10300f11-fdb3-43dd-a202-f2239bd052d8', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4130e887-48af-463d-ab3f-e4f6787bf66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4130e887-48af-463d-ab3f-e4f6787bf66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a321b000-9b61-44cb-ac34-6c4cb2791b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:18 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Volume 10300f11-fdb3-43dd-a202-f2239bd052d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10300f11-fdb3-43dd-a202-f2239bd052d8', 'volume_size': 1} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6bc3bc64-47b5-426d-a306-2b92fc37b644,created_at=2026-06-01T07:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1920187546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6bc3bc64-47b5-426d-a306-2b92fc37b644,host='devstack@QuobyteHD#QuobyteHD',id=10300f11-fdb3-43dd-a202-f2239bd052d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c6b6add54b40ac88c2df20b2b832c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:29:18Z,use_quota=True,user_id='e5a622f7cf7c4fb991d1825309c10c19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb05daf5-4a65-4aa2-a2a1-b7e2b682da82),volume_type_id=cb05daf5-4a65-4aa2-a2a1-b7e2b682da82)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Creating volume 10300f11-fdb3-43dd-a202-f2239bd052d8 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:29:18 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:29:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10300f11-fdb3-43dd-a202-f2239bd052d8 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:18 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10300f11-fdb3-43dd-a202-f2239bd052d8 1073741824 Jun 01 09:29:18 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:19 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10300f11-fdb3-43dd-a202-f2239bd052d8 1073741824" returned: 0 in 0.985s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10300f11-fdb3-43dd-a202-f2239bd052d8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:19 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10300f11-fdb3-43dd-a202-f2239bd052d8 Jun 01 09:29:19 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:20 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10300f11-fdb3-43dd-a202-f2239bd052d8" returned: 0 in 0.693s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:29:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a321b000-9b61-44cb-ac34-6c4cb2791b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10300f11-fdb3-43dd-a202-f2239bd052d8', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7821edc-ce7b-4433-8fde-504cad67e1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:20 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Volume volume-10300f11-fdb3-43dd-a202-f2239bd052d8 (10300f11-fdb3-43dd-a202-f2239bd052d8): created successfully Jun 01 09:29:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7821edc-ce7b-4433-8fde-504cad67e1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Flow 'volume_create_manager' (c9bf9264-b149-4d8a-984c-e3f447dc4115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:29:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-456b616e-a1c1-427a-825f-b3e24dda7812 tempest-GroupsTest-220907046 None] Created volume successfully. Jun 01 09:29:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d855e8dd-9367-4321-8f24-abe61cdbbe34 tempest-GroupsTest-220907046 None] Update group completed successfully. Jun 01 09:29:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3cbdccc5-7b6f-4ea3-a6d3-c74399663988 tempest-GroupsTest-220907046 None] Update group completed successfully. Jun 01 09:29:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Acquiring lock "cinder-quobyte-10300f11-fdb3-43dd-a202-f2239bd052d8" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:29:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Lock "cinder-quobyte-10300f11-fdb3-43dd-a202-f2239bd052d8" acquired by "delete_volume" :: waited 0.032s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:29:23 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[615a098e-d12e-4476-ad54-1bac97ed0486]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:29:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10300f11-fdb3-43dd-a202-f2239bd052d8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:23 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:29:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Flow 'volume_create_manager' (83a5c712-5383-4e57-a242-9f685367a2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:29:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a323d10-915a-403b-a786-19b2356b903e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a323d10-915a-403b-a786-19b2356b903e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-524462850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335f20d8-76e6-4b1e-9bf3-1fb2608e5393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444e482aedf84c878ff1a321583dc6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:29:24Z,use_quota=True,user_id='97df14951e4d4d10b6cbc9059ac5c1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0585556-7a0e-41d9-ab6f-aec25d7c3adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0585556-7a0e-41d9-ab6f-aec25d7c3adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c555e39a-0caa-45b2-bd7d-76b0abd9cc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c555e39a-0caa-45b2-bd7d-76b0abd9cc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '335f20d8-76e6-4b1e-9bf3-1fb2608e5393', 'volume_name': 'volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aaea0aa-5f37-4506-a1ee-9073203083c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aaea0aa-5f37-4506-a1ee-9073203083c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84be4bc3-37fc-4b7a-9a4d-209bc35eed74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:24 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Volume 335f20d8-76e6-4b1e-9bf3-1fb2608e5393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393', 'volume_size': 1} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-524462850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335f20d8-76e6-4b1e-9bf3-1fb2608e5393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444e482aedf84c878ff1a321583dc6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:29:24Z,use_quota=True,user_id='97df14951e4d4d10b6cbc9059ac5c1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Creating volume 335f20d8-76e6-4b1e-9bf3-1fb2608e5393 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:24 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10300f11-fdb3-43dd-a202-f2239bd052d8 Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:29:24 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:24 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:24 devstack sudo[89673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393 1073741824 Jun 01 09:29:24 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:24 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10300f11-fdb3-43dd-a202-f2239bd052d8" returned: 0 in 0.902s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10300f11-fdb3-43dd-a202-f2239bd052d8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:24 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10300f11-fdb3-43dd-a202-f2239bd052d8 Jun 01 09:29:24 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:25 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393 1073741824" returned: 0 in 1.006s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:25 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393 Jun 01 09:29:25 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:25 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-10300f11-fdb3-43dd-a202-f2239bd052d8" returned: 0 in 0.738s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Lock "cinder-quobyte-10300f11-fdb3-43dd-a202-f2239bd052d8" released by "delete_volume" :: held 1.728s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:29:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Acquiring lock "cinder-quobyte-26e2a0df-4c24-42b3-ae23-088b749cce48" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:29:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Lock "cinder-quobyte-26e2a0df-4c24-42b3-ae23-088b749cce48" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:29:25 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7ec3c1-41c0-418e-8c7a-5573cf1abd0c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:29:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-26e2a0df-4c24-42b3-ae23-088b749cce48 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:25 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-26e2a0df-4c24-42b3-ae23-088b749cce48 Jun 01 09:29:25 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:25 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393" returned: 0 in 0.768s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:29:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84be4bc3-37fc-4b7a-9a4d-209bc35eed74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d3b69b-c09c-486b-8a03-a143d777a484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:26 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Volume volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393 (335f20d8-76e6-4b1e-9bf3-1fb2608e5393): created successfully Jun 01 09:29:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d3b69b-c09c-486b-8a03-a143d777a484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Flow 'volume_create_manager' (83a5c712-5383-4e57-a242-9f685367a2cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:29:26 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4f0fbdde-9a2a-4c7b-b387-bf393c1022ab tempest-TaggedAttachmentsTest-1324730414 None] Created volume successfully. Jun 01 09:29:26 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-26e2a0df-4c24-42b3-ae23-088b749cce48" returned: 0 in 1.051s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-26e2a0df-4c24-42b3-ae23-088b749cce48 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:26 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-26e2a0df-4c24-42b3-ae23-088b749cce48 Jun 01 09:29:26 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:27 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-26e2a0df-4c24-42b3-ae23-088b749cce48" returned: 0 in 0.625s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Lock "cinder-quobyte-26e2a0df-4c24-42b3-ae23-088b749cce48" released by "delete_volume" :: held 1.722s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:29:27 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Created reservations ['b1d127d5-6784-48cb-b4ee-66eb1af8f1cf'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:29:27 devstack cinder-volume[86649]: WARNING cinder.quota [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-686246119 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-686246119, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:29:27 devstack cinder-volume[86649]: WARNING cinder.quota [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-686246119 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-686246119, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:29:27 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Created reservations ['23dbe2e6-a66b-42b9-adca-a395abd42b8e', 'fb8bb3f3-998e-40a9-9240-25be9f8ff23c', '0c63de5a-c9c0-4f42-aeb4-947234242fd4', '03b27c20-46e3-480c-84e1-03e0ac0207e1'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:29:27 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Created reservations ['11b7b413-e63d-4bb6-8138-6b58d8d03ba2', '12423190-5e50-404f-a257-37a07123364d', '4d1ad4cc-9c52-45ea-bff4-76aca6bf03ae', 'e5833a25-c1da-4add-8482-545a946f4c89'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:29:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:29:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:29:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:27 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:29:27 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Flow 'volume_create_manager' (1e7dbfed-fae9-464d-ac14-2430fb6e94bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912244f8-3b96-45ce-9934-1227915c6315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912244f8-3b96-45ce-9934-1227915c6315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-664821742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5937f78f-ffd1-4c7b-aeaf-794751de6536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae848e9102940c092d4e8bbced46e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:29:28Z,use_quota=True,user_id='1271b039186f46efb79203f5db531851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb364ed-5ff1-4361-b02b-c72f9f032c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb364ed-5ff1-4361-b02b-c72f9f032c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d2a40f-f5f5-422d-bfa1-99568b61e12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d2a40f-f5f5-422d-bfa1-99568b61e12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5937f78f-ffd1-4c7b-aeaf-794751de6536', 'volume_name': 'volume-5937f78f-ffd1-4c7b-aeaf-794751de6536', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8198cd82-23e4-42a6-bf66-908ff38263ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8198cd82-23e4-42a6-bf66-908ff38263ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e00952-c97d-41cd-b1dd-67c3d42b3ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Volume 5937f78f-ffd1-4c7b-aeaf-794751de6536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5937f78f-ffd1-4c7b-aeaf-794751de6536', 'volume_size': 1} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-664821742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5937f78f-ffd1-4c7b-aeaf-794751de6536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae848e9102940c092d4e8bbced46e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:29:28Z,use_quota=True,user_id='1271b039186f46efb79203f5db531851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Creating volume 5937f78f-ffd1-4c7b-aeaf-794751de6536 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:29:28 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:29:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:28 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536 1073741824 Jun 01 09:29:28 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:29 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.317s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:29 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:29:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-73d94a17-c6b9-4d85-8a0a-75cd21e31805 tempest-GroupsTest-220907046 None] Delete group completed successfully. Jun 01 09:29:29 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536 1073741824" returned: 0 in 1.133s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:29 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536 Jun 01 09:29:29 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:30 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536" returned: 0 in 0.794s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:29:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e00952-c97d-41cd-b1dd-67c3d42b3ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5937f78f-ffd1-4c7b-aeaf-794751de6536', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cd3a8d-da85-4f75-8fec-2b3ca5a2712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:30 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Volume volume-5937f78f-ffd1-4c7b-aeaf-794751de6536 (5937f78f-ffd1-4c7b-aeaf-794751de6536): created successfully Jun 01 09:29:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cd3a8d-da85-4f75-8fec-2b3ca5a2712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Flow 'volume_create_manager' (1e7dbfed-fae9-464d-ac14-2430fb6e94bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:29:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-63db284e-5ca7-4910-9953-0310db98ffa0 tempest-AttachVolumeTestJSON-1055284462 None] Created volume successfully. Jun 01 09:29:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-1ab98bca-59bb-45f5-a66e-ffd6be562e68 req-112478c6-6b7b-4b89-8ad2-1cd295740102 tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-1ab98bca-59bb-45f5-a66e-ffd6be562e68 req-112478c6-6b7b-4b89-8ad2-1cd295740102 tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[faab4772-0a50-496b-bf49-6e5abc7d4cb0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:29:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-1ab98bca-59bb-45f5-a66e-ffd6be562e68 req-112478c6-6b7b-4b89-8ad2-1cd295740102 tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:35 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536 Jun 01 09:29:35 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:35 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-1ab98bca-59bb-45f5-a66e-ffd6be562e68 req-112478c6-6b7b-4b89-8ad2-1cd295740102 tempest-AttachVolumeTestJSON-1055284462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536" returned: 0 in 0.760s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-1ab98bca-59bb-45f5-a66e-ffd6be562e68 req-112478c6-6b7b-4b89-8ad2-1cd295740102 tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.800s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-1ab98bca-59bb-45f5-a66e-ffd6be562e68 req-112478c6-6b7b-4b89-8ad2-1cd295740102 tempest-AttachVolumeTestJSON-1055284462 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-5937f78f-ffd1-4c7b-aeaf-794751de6536', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddafcdae-6d7c-4d0e-8ac1-745209d79f08', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:29:35 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-1ab98bca-59bb-45f5-a66e-ffd6be562e68 req-112478c6-6b7b-4b89-8ad2-1cd295740102 tempest-AttachVolumeTestJSON-1055284462 None] attachment_update completed successfully. Jun 01 09:29:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:29:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:29:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:29:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:36 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:29:36 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:37 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.183s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:29:45 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=90,cinder:UPDATE=74,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:29:45 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=94,cinder:DELETE=2,cinder:SELECT=95,cinder:INSERT=14 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:29:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-e824eefc-c294-434e-bfbb-9aee74237f6c req-f94a817a-d938-4207-827a-86888a3a9afa tempest-ServerActionsTestOtherA-2033220616 None] Terminate volume connection completed successfully. Jun 01 09:29:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e824eefc-c294-434e-bfbb-9aee74237f6c req-f94a817a-d938-4207-827a-86888a3a9afa tempest-ServerActionsTestOtherA-2033220616 None] Deleting attachment 3c16237d-4c28-406c-a781-3812b65d434f. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Flow 'volume_create_manager' (66993e86-fd02-498e-87d2-41782cbcb611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4151ae-08a3-4fdc-afc4-bbad94b46a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4151ae-08a3-4fdc-afc4-bbad94b46a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-531283887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b760e1-0304-4227-afba-a78a82c337a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5e329fb4ec4f008dab4c889963b710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:29:59Z,use_quota=True,user_id='ac0e58df21864eb0b942adea9056886e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a9c340-2ec1-489c-8bad-a32c276ae141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a9c340-2ec1-489c-8bad-a32c276ae141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93a09c4-8cdf-4e19-8831-1b3ca5dcf4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93a09c4-8cdf-4e19-8831-1b3ca5dcf4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b760e1-0304-4227-afba-a78a82c337a6', 'volume_name': 'volume-b8b760e1-0304-4227-afba-a78a82c337a6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c725567-37bd-4671-8cd7-d1fee8eb1af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c725567-37bd-4671-8cd7-d1fee8eb1af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6f5ce3-b7a9-4cd5-b40b-51502bf75f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:29:59 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Volume b8b760e1-0304-4227-afba-a78a82c337a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b760e1-0304-4227-afba-a78a82c337a6', 'volume_size': 1} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-531283887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b760e1-0304-4227-afba-a78a82c337a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5e329fb4ec4f008dab4c889963b710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:29:59Z,use_quota=True,user_id='ac0e58df21864eb0b942adea9056886e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Creating volume b8b760e1-0304-4227-afba-a78a82c337a6 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:29:59 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b8b760e1-0304-4227-afba-a78a82c337a6 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:59 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b8b760e1-0304-4227-afba-a78a82c337a6 1073741824 Jun 01 09:29:59 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:29:59 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b8b760e1-0304-4227-afba-a78a82c337a6 1073741824" returned: 0 in 0.772s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:29:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b8b760e1-0304-4227-afba-a78a82c337a6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:29:59 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b8b760e1-0304-4227-afba-a78a82c337a6 Jun 01 09:29:59 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:00 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b8b760e1-0304-4227-afba-a78a82c337a6" returned: 0 in 0.611s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:30:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6f5ce3-b7a9-4cd5-b40b-51502bf75f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b760e1-0304-4227-afba-a78a82c337a6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788f345f-897d-422f-8ed6-5a7ecf14b13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:00 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Volume volume-b8b760e1-0304-4227-afba-a78a82c337a6 (b8b760e1-0304-4227-afba-a78a82c337a6): created successfully Jun 01 09:30:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788f345f-897d-422f-8ed6-5a7ecf14b13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Flow 'volume_create_manager' (66993e86-fd02-498e-87d2-41782cbcb611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:30:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-266d2766-c6e0-4237-b980-52a4c64ebada tempest-VolumesServicesTestJSON-573812680 None] Created volume successfully. Jun 01 09:30:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Acquiring lock "cinder-b8b760e1-0304-4227-afba-a78a82c337a6-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:30:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Lock "cinder-b8b760e1-0304-4227-afba-a78a82c337a6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:30:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Acquiring lock "cinder-quobyte-b8b760e1-0304-4227-afba-a78a82c337a6" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:30:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Lock "cinder-quobyte-b8b760e1-0304-4227-afba-a78a82c337a6" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:30:01 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d2c1fb-aec1-465b-83bb-10d64dbde9a0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:30:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b8b760e1-0304-4227-afba-a78a82c337a6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:01 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b8b760e1-0304-4227-afba-a78a82c337a6 Jun 01 09:30:01 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Acquiring lock "cinder-457995a5-7890-4b98-a270-feedd33df523-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Lock "cinder-457995a5-7890-4b98-a270-feedd33df523-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:30:02 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b8b760e1-0304-4227-afba-a78a82c337a6" returned: 0 in 0.757s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b8b760e1-0304-4227-afba-a78a82c337a6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:02 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b8b760e1-0304-4227-afba-a78a82c337a6 Jun 01 09:30:02 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Acquiring lock "cinder-quobyte-457995a5-7890-4b98-a270-feedd33df523" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Lock "cinder-quobyte-457995a5-7890-4b98-a270-feedd33df523" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2f6a4b-8e60-4d8c-8ca4-2ab8e1ceb637]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:02 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523 Jun 01 09:30:02 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:02 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b8b760e1-0304-4227-afba-a78a82c337a6" returned: 0 in 0.612s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Lock "cinder-quobyte-b8b760e1-0304-4227-afba-a78a82c337a6" released by "delete_volume" :: held 1.409s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Created reservations ['e47d14e8-a6de-4336-b90c-9fb21b1b59fc', 'c979a712-324c-4991-8f52-56d5df1d6a84', '9b62a7f4-9b17-4f0b-bb28-3c31771b396b', 'e362ea58-3853-4c5e-ae75-405d02b91d5d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:02 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:30:02 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:02 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523" returned: 0 in 0.742s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:02 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523 Jun 01 09:30:02 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:03 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.599s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:03 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:30:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Deleted volume successfully. Jun 01 09:30:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-558712e1-c846-4fdf-9d15-234ee5e42b04 tempest-VolumesServicesTestJSON-573812680 None] Lock "cinder-b8b760e1-0304-4227-afba-a78a82c337a6-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:30:03 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-457995a5-7890-4b98-a270-feedd33df523" returned: 0 in 0.633s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Lock "cinder-quobyte-457995a5-7890-4b98-a270-feedd33df523" released by "delete_volume" :: held 1.415s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:30:03 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Created reservations ['57d6ecaf-eb8b-4dcb-92a6-3dd8b44712fe', '6d1cee7b-cff6-4f27-9fca-d1878dc64a28', '56a3eff1-3ceb-49d5-9b60-dab6e938c55f', 'a3ee2612-2ebc-4317-a6f6-97ceaf66b458'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:30:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:30:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:30:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:03 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:30:03 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:04 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.635s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:04 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:30:04 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Deleted volume successfully. Jun 01 09:30:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6e86f07a-e923-4638-b12f-99b4bc2b5632 tempest-ServerActionsTestOtherA-2033220616 None] Lock "cinder-457995a5-7890-4b98-a270-feedd33df523-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:30:08 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:30:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Flow 'volume_create_manager' (79d78508-c754-4294-b9c2-10b5a8f97426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:30:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4502ff9d-f5dc-40ac-a6b3-2051d59e3aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4502ff9d-f5dc-40ac-a6b3-2051d59e3aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1124707987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0100a6ee-7adb-4289-8b7b-5eaae6d03047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f97caa0435f48db9fa9cc7f973ba467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:30:09Z,use_quota=True,user_id='a15443f2fa204141afa5f6bb8557a2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab74be39-9f64-4c75-a6d9-e71958936d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab74be39-9f64-4c75-a6d9-e71958936d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd3d15d-4c46-4df8-a009-d70cf6ca41c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:08 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 01 09:30:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd3d15d-4c46-4df8-a009-d70cf6ca41c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0100a6ee-7adb-4289-8b7b-5eaae6d03047', 'volume_name': 'volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047', 'volume_size': 1, 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e7cfcad8294f4eb88f2de87e0a453e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'created_at': datetime.datetime(2026, 6, 1, 7, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc5c3fe-1254-45d8-9653-4b286c1db464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc5c3fe-1254-45d8-9653-4b286c1db464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e699fd5-29e1-4833-817b-1c92c3c87806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:08 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Volume 0100a6ee-7adb-4289-8b7b-5eaae6d03047: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047', 'volume_size': 1, 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e7cfcad8294f4eb88f2de87e0a453e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'created_at': datetime.datetime(2026, 6, 1, 7, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 01 09:30:08 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Trying to clone 0100a6ee-7adb-4289-8b7b-5eaae6d03047 from image c04f6c24-cff4-40fb-8629-0b2dcb859f85 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 01 09:30:09 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__banyf9ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 01 09:30:09 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Image download 20.69 MB at 20.69 MB/s Jun 01 09:30:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adbb579-29cc-4047-9309-ca3451ea3afc]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:30:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__banyf9ydevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:09 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__banyf9ydevstack@QuobyteHD Jun 01 09:30:09 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:10 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__banyf9ydevstack@QuobyteHD" returned: 0 in 0.707s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Temporary image c04f6c24-cff4-40fb-8629-0b2dcb859f85 is fetched for user a15443f2fa204141afa5f6bb8557a2ce. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[64853434-3934-441e-8a9b-c50cacd7d3e1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__banyf9ydevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:10 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__banyf9ydevstack@QuobyteHD Jun 01 09:30:10 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:10 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__banyf9ydevstack@QuobyteHD" returned: 0 in 0.688s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1124707987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0100a6ee-7adb-4289-8b7b-5eaae6d03047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f97caa0435f48db9fa9cc7f973ba467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:30:09Z,use_quota=True,user_id='a15443f2fa204141afa5f6bb8557a2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Creating volume 0100a6ee-7adb-4289-8b7b-5eaae6d03047 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:30:10 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:30:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:10 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 1073741824 Jun 01 09:30:10 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:11 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 1073741824" returned: 0 in 0.763s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:11 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 Jun 01 09:30:11 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:12 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047" returned: 0 in 0.608s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:30:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:12 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Attempting download of c04f6c24-cff4-40fb-8629-0b2dcb859f85 ((None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}])) to volume 0100a6ee-7adb-4289-8b7b-5eaae6d03047. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 01 09:30:12 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0365047e-5429-4a70-8c3c-4281aa405b4f]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:30:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_78ymrmj0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:12 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_78ymrmj0 Jun 01 09:30:12 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:13 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_78ymrmj0" returned: 0 in 0.734s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_78ymrmj0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:13 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_78ymrmj0 Jun 01 09:30:13 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:13 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_78ymrmj0" returned: 1 in 0.735s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_78ymrmj0' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:30:13 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e600724-b0e4-48c3-afb1-aa3048100eab]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:30:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__banyf9ydevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:13 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__banyf9ydevstack@QuobyteHD Jun 01 09:30:13 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:14 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__banyf9ydevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:14 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] c04f6c24-cff4-40fb-8629-0b2dcb859f85 was qcow2, converting to raw {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 01 09:30:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__banyf9ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:14 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__banyf9ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 Jun 01 09:30:14 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:16 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__banyf9ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047" returned: 0 in 2.309s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:16 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__banyf9ydevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:30:16 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Converted 112.00 MB image at 48.48 MB/s Jun 01 09:30:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:16 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 1G Jun 01 09:30:16 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:17 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 1G" returned: 0 in 0.742s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:17 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[30473be3-3904-43be-b30d-018c59747bc2]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:30:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:17 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 Jun 01 09:30:17 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:18 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047" returned: 0 in 1.220s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:19 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 Jun 01 09:30:19 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:19 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047" returned: 1 in 0.776s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Downloaded image c04f6c24-cff4-40fb-8629-0b2dcb859f85 ((None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}])) to volume 0100a6ee-7adb-4289-8b7b-5eaae6d03047 successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 01 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Temporary image c04f6c24-cff4-40fb-8629-0b2dcb859f85 for user a15443f2fa204141afa5f6bb8557a2ce is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 01 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Marking volume 0100a6ee-7adb-4289-8b7b-5eaae6d03047 as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 01 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Copying metadata from image c04f6c24-cff4-40fb-8629-0b2dcb859f85 to 0100a6ee-7adb-4289-8b7b-5eaae6d03047. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 01 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Creating volume glance metadata for volume 0100a6ee-7adb-4289-8b7b-5eaae6d03047 backed by image c04f6c24-cff4-40fb-8629-0b2dcb859f85 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 01 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e699fd5-29e1-4833-817b-1c92c3c87806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047', 'volume_size': 1, 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e7cfcad8294f4eb88f2de87e0a453e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'created_at': datetime.datetime(2026, 6, 1, 7, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5614733-ef7a-4677-9510-085af42df333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:19 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Volume volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 (0100a6ee-7adb-4289-8b7b-5eaae6d03047): created successfully Jun 01 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5614733-ef7a-4677-9510-085af42df333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Flow 'volume_create_manager' (79d78508-c754-4294-b9c2-10b5a8f97426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:30:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9116eba9-0975-4b73-ba8e-2d97a3f9f4eb tempest-VolumesImageMetadata-1631629903 None] Created volume successfully. Jun 01 09:30:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Acquiring lock "cinder-0100a6ee-7adb-4289-8b7b-5eaae6d03047-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:30:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Lock "cinder-0100a6ee-7adb-4289-8b7b-5eaae6d03047-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:30:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Acquiring lock "cinder-quobyte-0100a6ee-7adb-4289-8b7b-5eaae6d03047" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:30:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Lock "cinder-quobyte-0100a6ee-7adb-4289-8b7b-5eaae6d03047" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:30:20 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[811278a7-8bc5-4439-b9c5-168330b78bf9]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:30:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:21 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 Jun 01 09:30:21 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:21 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047" returned: 0 in 0.765s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:21 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 Jun 01 09:30:21 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:22 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047" returned: 1 in 0.720s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:30:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:22 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047 Jun 01 09:30:22 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:23 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0100a6ee-7adb-4289-8b7b-5eaae6d03047" returned: 0 in 0.635s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Lock "cinder-quobyte-0100a6ee-7adb-4289-8b7b-5eaae6d03047" released by "delete_volume" :: held 2.183s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:30:23 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Created reservations ['27cbd05d-c5ed-491c-a519-b602f008c65a', '7f7b7c3a-b41a-4e2b-9e78-57848b7f0340', 'eeaad8d5-1ed1-4e16-a736-a19c6db5d286', 'd8661f48-8c68-48d8-abb4-60089143ceae'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:30:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:30:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:30:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:23 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:30:23 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:23 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.727s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:23 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:30:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Deleted volume successfully. Jun 01 09:30:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4900e3ee-dcb4-43f6-8e54-9c2b8e30b0a1 tempest-VolumesImageMetadata-1631629903 None] Lock "cinder-0100a6ee-7adb-4289-8b7b-5eaae6d03047-delete_volume" released by "delete_volume" :: held 3.112s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:30:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-9ec2bec3-c620-46de-bc25-8fb78f7032c2 req-b25c41aa-5d24-414f-8259-c56c3ea2d7f4 tempest-TaggedAttachmentsTest-1324730414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-9ec2bec3-c620-46de-bc25-8fb78f7032c2 req-b25c41aa-5d24-414f-8259-c56c3ea2d7f4 tempest-TaggedAttachmentsTest-1324730414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:24 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d312cc-bd08-4fde-b3db-ad9c3f23ea1e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:30:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-9ec2bec3-c620-46de-bc25-8fb78f7032c2 req-b25c41aa-5d24-414f-8259-c56c3ea2d7f4 tempest-TaggedAttachmentsTest-1324730414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:24 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393 Jun 01 09:30:24 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:25 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-9ec2bec3-c620-46de-bc25-8fb78f7032c2 req-b25c41aa-5d24-414f-8259-c56c3ea2d7f4 tempest-TaggedAttachmentsTest-1324730414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393" returned: 0 in 0.846s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-9ec2bec3-c620-46de-bc25-8fb78f7032c2 req-b25c41aa-5d24-414f-8259-c56c3ea2d7f4 tempest-TaggedAttachmentsTest-1324730414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.877s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-9ec2bec3-c620-46de-bc25-8fb78f7032c2 req-b25c41aa-5d24-414f-8259-c56c3ea2d7f4 tempest-TaggedAttachmentsTest-1324730414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0658a64-7369-4b54-91f2-c1772c0288c7', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:30:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-9ec2bec3-c620-46de-bc25-8fb78f7032c2 req-b25c41aa-5d24-414f-8259-c56c3ea2d7f4 tempest-TaggedAttachmentsTest-1324730414 None] attachment_update completed successfully. Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Flow 'volume_create_manager' (e4f400a9-83af-4a8f-baf6-6be05402288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ef4ad2-a12f-4d27-bc0e-62d23a5970a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ef4ad2-a12f-4d27-bc0e-62d23a5970a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-766636759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d4a37062ef456eaeb9d57115dc6612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:30:28Z,use_quota=True,user_id='6959e804d5af4b8f91fd6a064bf2b07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a1c7ec-2760-4cd6-b279-8977b8d6c0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a1c7ec-2760-4cd6-b279-8977b8d6c0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790a608c-eacb-4b34-a9e9-35b4f829a628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790a608c-eacb-4b34-a9e9-35b4f829a628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710', 'volume_name': 'volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdb9360-b71a-45d2-8504-8d27a59617ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdb9360-b71a-45d2-8504-8d27a59617ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab48101-e03c-4461-ae0a-e421d78959ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Volume ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710', 'volume_size': 1} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-766636759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d4a37062ef456eaeb9d57115dc6612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:30:28Z,use_quota=True,user_id='6959e804d5af4b8f91fd6a064bf2b07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Creating volume ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:30:28 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:30:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:28 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710 1073741824 Jun 01 09:30:28 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:29 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710 1073741824" returned: 0 in 0.921s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:29 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710 Jun 01 09:30:29 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:29 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710" returned: 0 in 0.640s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:30:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab48101-e03c-4461-ae0a-e421d78959ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc51386-dfd8-42bc-95ad-3724128011b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:29 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Volume volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710 (ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710): created successfully Jun 01 09:30:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc51386-dfd8-42bc-95ad-3724128011b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Flow 'volume_create_manager' (e4f400a9-83af-4a8f-baf6-6be05402288e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:30:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a8f33922-1268-4199-8bcc-bf6b9a31344d tempest-AbsoluteLimitsTests-834700081 None] Created volume successfully. Jun 01 09:30:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Acquiring lock "cinder-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:30:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Lock "cinder-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:30:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Acquiring lock "cinder-quobyte-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:30:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Lock "cinder-quobyte-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710" acquired by "delete_volume" :: waited 0.032s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:30:30 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4400107c-5026-4ebc-95f2-89283a7564da]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:30:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:30 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710 Jun 01 09:30:30 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:31 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710" returned: 0 in 0.878s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:31 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710 Jun 01 09:30:31 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:32 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710" returned: 0 in 0.610s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Lock "cinder-quobyte-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710" released by "delete_volume" :: held 1.558s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:30:32 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Created reservations ['ae95f07d-645f-4de2-8b36-5eb6b996366b', '50cef505-d112-44ac-87a7-b8ed119ddc6b', '80b31cf7-1ceb-48e6-bab4-af8dc45ca8ea', '3c464ddc-519f-47e0-a269-97fe376524ef'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:30:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:30:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:30:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:32 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:30:32 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-2912a802-c523-4ad7-9c9e-2c37af0360f8 req-d736ca2e-0772-49a7-8ac2-d1e830bc0e32 tempest-TaggedAttachmentsTest-1324730414 None] Terminate volume connection completed successfully. Jun 01 09:30:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-2912a802-c523-4ad7-9c9e-2c37af0360f8 req-d736ca2e-0772-49a7-8ac2-d1e830bc0e32 tempest-TaggedAttachmentsTest-1324730414 None] Deleting attachment a0658a64-7369-4b54-91f2-c1772c0288c7. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:30:32 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.727s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:32 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:30:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Deleted volume successfully. Jun 01 09:30:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fe607b56-9674-4167-9e97-c8904f35b59b tempest-AbsoluteLimitsTests-834700081 None] Lock "cinder-ae8e4bb0-b9fd-4e7e-b92b-ba880c2ff710-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:30:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:30:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:30:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:30:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:36 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:30:36 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:30:37 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Flow 'volume_create_manager' (65481574-8446-4d8e-8ec9-afd7fdd86be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6983ffdd-16fd-472a-bc08-29128a7d208d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.960s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6983ffdd-16fd-472a-bc08-29128a7d208d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-81481896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e202ffd-0434-48a4-ac5a-56419968ae1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb8c4e46f4b9466f97a461996f19a10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:30:38Z,use_quota=True,user_id='fb13a82676f2434b8722a95ffb017499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7a6c66-cb6a-4452-a079-8d9f70cc46e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7a6c66-cb6a-4452-a079-8d9f70cc46e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6212a1e2-a88d-4312-bad0-a2d8d170a44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6212a1e2-a88d-4312-bad0-a2d8d170a44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e202ffd-0434-48a4-ac5a-56419968ae1a', 'volume_name': 'volume-1e202ffd-0434-48a4-ac5a-56419968ae1a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee27ece-3eb9-44f0-97b5-3f075528fced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee27ece-3eb9-44f0-97b5-3f075528fced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b980ff40-5059-45f6-b354-fca8dd34a516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:37 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Volume 1e202ffd-0434-48a4-ac5a-56419968ae1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e202ffd-0434-48a4-ac5a-56419968ae1a', 'volume_size': 1} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-81481896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e202ffd-0434-48a4-ac5a-56419968ae1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb8c4e46f4b9466f97a461996f19a10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:30:38Z,use_quota=True,user_id='fb13a82676f2434b8722a95ffb017499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Creating volume 1e202ffd-0434-48a4-ac5a-56419968ae1a {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:30:37 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:30:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1e202ffd-0434-48a4-ac5a-56419968ae1a 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:37 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1e202ffd-0434-48a4-ac5a-56419968ae1a 1073741824 Jun 01 09:30:37 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:38 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1e202ffd-0434-48a4-ac5a-56419968ae1a 1073741824" returned: 0 in 1.019s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1e202ffd-0434-48a4-ac5a-56419968ae1a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:38 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1e202ffd-0434-48a4-ac5a-56419968ae1a Jun 01 09:30:38 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:39 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1e202ffd-0434-48a4-ac5a-56419968ae1a" returned: 0 in 0.659s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:30:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b980ff40-5059-45f6-b354-fca8dd34a516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e202ffd-0434-48a4-ac5a-56419968ae1a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d3324a-f1fd-4b10-9281-8d5b6bc6155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:39 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Volume volume-1e202ffd-0434-48a4-ac5a-56419968ae1a (1e202ffd-0434-48a4-ac5a-56419968ae1a): created successfully Jun 01 09:30:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d3324a-f1fd-4b10-9281-8d5b6bc6155e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Flow 'volume_create_manager' (65481574-8446-4d8e-8ec9-afd7fdd86be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:30:39 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8dd7860b-36c2-4cfc-b214-dcf584748f10 tempest-VolumesMetadataTest-2104615999 None] Created volume successfully. Jun 01 09:30:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Acquiring lock "cinder-1e202ffd-0434-48a4-ac5a-56419968ae1a-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:30:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Lock "cinder-1e202ffd-0434-48a4-ac5a-56419968ae1a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:30:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Acquiring lock "cinder-quobyte-1e202ffd-0434-48a4-ac5a-56419968ae1a" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:30:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Lock "cinder-quobyte-1e202ffd-0434-48a4-ac5a-56419968ae1a" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:30:40 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c4976f-e988-4c71-b37c-1d36cbd79ead]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:30:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1e202ffd-0434-48a4-ac5a-56419968ae1a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:40 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1e202ffd-0434-48a4-ac5a-56419968ae1a Jun 01 09:30:40 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:41 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1e202ffd-0434-48a4-ac5a-56419968ae1a" returned: 0 in 0.718s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1e202ffd-0434-48a4-ac5a-56419968ae1a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:41 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1e202ffd-0434-48a4-ac5a-56419968ae1a Jun 01 09:30:41 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:41 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1e202ffd-0434-48a4-ac5a-56419968ae1a" returned: 0 in 0.614s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Lock "cinder-quobyte-1e202ffd-0434-48a4-ac5a-56419968ae1a" released by "delete_volume" :: held 1.376s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:30:42 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Created reservations ['1bb9eea4-5d55-4475-9fdc-5f18302f87d6', 'a8663025-da13-4884-9bb4-570af8ef7a10', 'f6e49d21-04c3-4d76-8b08-d6ebe36381ae', '24e286ff-43d0-4cb2-8fe0-240857d73103'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:30:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:30:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:30:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:42 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:30:42 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:42 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.643s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:42 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:30:42 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Deleted volume successfully. Jun 01 09:30:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73784136-61f3-4da1-90ed-8de42d337389 tempest-VolumesMetadataTest-2104615999 None] Lock "cinder-1e202ffd-0434-48a4-ac5a-56419968ae1a-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:30:51 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=53,cinder:UPDATE=56,cinder:DELETE=6,cinder:INSERT=20 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:30:51 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=45,cinder:UPDATE=56,cinder:INSERT=17,cinder:DELETE=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:30:51 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:30:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Flow 'volume_create_manager' (e126f32a-eb45-4d3e-8552-7282be22922c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:30:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbdac36-4286-4d37-bfdc-87223c93a8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbdac36-4286-4d37-bfdc-87223c93a8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1883585748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683eb922-a1c8-456c-b8ae-6843685ae68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1586f94f1866434f986b3f46b69445f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:30:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:30:52Z,use_quota=True,user_id='3db11e1f4a90460a81a98be6fb065d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9750d9-4436-41c9-a764-69506b23f0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9750d9-4436-41c9-a764-69506b23f0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75b4c76-2f88-4653-8cd0-74391558e555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75b4c76-2f88-4653-8cd0-74391558e555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '683eb922-a1c8-456c-b8ae-6843685ae68f', 'volume_name': 'volume-683eb922-a1c8-456c-b8ae-6843685ae68f', 'volume_size': 2}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a425d972-943d-4cfb-930b-1505b9853ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a425d972-943d-4cfb-930b-1505b9853ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62df7d80-52b7-4369-a37a-cd031bf9f9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:52 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Volume 683eb922-a1c8-456c-b8ae-6843685ae68f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-683eb922-a1c8-456c-b8ae-6843685ae68f', 'volume_size': 2} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1883585748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683eb922-a1c8-456c-b8ae-6843685ae68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1586f94f1866434f986b3f46b69445f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:30:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:30:52Z,use_quota=True,user_id='3db11e1f4a90460a81a98be6fb065d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Creating volume 683eb922-a1c8-456c-b8ae-6843685ae68f {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:30:52 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:30:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f 2147483648 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:52 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f 2147483648 Jun 01 09:30:52 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:53 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f 2147483648" returned: 0 in 1.212s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:53 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f Jun 01 09:30:53 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:54 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f" returned: 0 in 1.364s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] <== create_volume: return (2686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:30:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.689s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62df7d80-52b7-4369-a37a-cd031bf9f9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-683eb922-a1c8-456c-b8ae-6843685ae68f', 'volume_size': 2}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b110c9-7ef4-46b5-8bd2-a4328fb96e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:30:54 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Volume volume-683eb922-a1c8-456c-b8ae-6843685ae68f (683eb922-a1c8-456c-b8ae-6843685ae68f): created successfully Jun 01 09:30:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b110c9-7ef4-46b5-8bd2-a4328fb96e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:30:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Flow 'volume_create_manager' (e126f32a-eb45-4d3e-8552-7282be22922c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:30:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5f4bc8d1-9a29-462d-ac5e-59fd46e3c393 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Created volume successfully. Jun 01 09:30:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Creating offline snapshot 2ae3bd3d-29ac-46e3-abba-5547b25967cd of volume 683eb922-a1c8-456c-b8ae-6843685ae68f {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:30:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdc34b1-eeb2-44ef-8ad8-092c4ca63c76]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:30:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:56 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f Jun 01 09:30:56 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Acquiring lock "cinder-335f20d8-76e6-4b1e-9bf3-1fb2608e5393-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:30:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Lock "cinder-335f20d8-76e6-4b1e-9bf3-1fb2608e5393-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:30:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Acquiring lock "cinder-quobyte-335f20d8-76e6-4b1e-9bf3-1fb2608e5393" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:30:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Lock "cinder-quobyte-335f20d8-76e6-4b1e-9bf3-1fb2608e5393" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:30:56 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[855e9243-e55c-4c0a-b245-eb9770284844]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:30:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:56 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393 Jun 01 09:30:56 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:56 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f" returned: 0 in 0.761s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd 2G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:56 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd 2G Jun 01 09:30:56 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:57 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393" returned: 0 in 0.926s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:57 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393 Jun 01 09:30:57 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:57 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd 2G" returned: 0 in 0.943s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-683eb922-a1c8-456c-b8ae-6843685ae68f -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:57 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-683eb922-a1c8-456c-b8ae-6843685ae68f -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd Jun 01 09:30:57 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:57 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-335f20d8-76e6-4b1e-9bf3-1fb2608e5393" returned: 0 in 0.618s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Lock "cinder-quobyte-335f20d8-76e6-4b1e-9bf3-1fb2608e5393" released by "delete_volume" :: held 1.592s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:30:57 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Created reservations ['7475e694-5017-4e69-a713-078e3ea45f26', '94cf5db3-a526-4639-b7f0-4f6c945fc714', '9eb635a3-e0f0-42e7-b484-56ee1518fc29', '78d113e8-7627-4819-95ca-08f5daa78751'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:30:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:30:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:30:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:30:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:30:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:30:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:57 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:30:57 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:58 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-683eb922-a1c8-456c-b8ae-6843685ae68f -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd" returned: 0 in 0.873s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:58 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd is being set with open permissions: ugo+rw Jun 01 09:30:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:58 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd Jun 01 09:30:58 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:58 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.768s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:30:58 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Deleted volume successfully. Jun 01 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3bcf19c6-aed3-45cf-b541-ec040d57d4e6 tempest-TaggedAttachmentsTest-1324730414 None] Lock "cinder-335f20d8-76e6-4b1e-9bf3-1fb2608e5393-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:30:59 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd" returned: 0 in 0.727s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:30:59 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.info Jun 01 09:30:59 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:30:59 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Jun 01 09:30:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.info" returned: 0 in 0.757s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:30:59 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.info is being set with open permissions: ugo+rw Jun 01 09:30:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:00 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.info Jun 01 09:31:00 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:00 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.info" returned: 0 in 0.770s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.962s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:31:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3f04790b-04dc-449c-a1a2-424f8c057731 tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Create snapshot completed successfully Jun 01 09:31:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Acquiring lock "cinder-2ae3bd3d-29ac-46e3-abba-5547b25967cd-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:31:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "cinder-2ae3bd3d-29ac-46e3-abba-5547b25967cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:31:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Acquiring lock "cinder-quobyte-683eb922-a1c8-456c-b8ae-6843685ae68f" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:31:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "cinder-quobyte-683eb922-a1c8-456c-b8ae-6843685ae68f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:31:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Acquiring lock "cinder-quobyte-2ae3bd3d-29ac-46e3-abba-5547b25967cd" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:31:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "cinder-quobyte-2ae3bd3d-29ac-46e3-abba-5547b25967cd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:31:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Deleting offline snapshot 2ae3bd3d-29ac-46e3-abba-5547b25967cd of volume 683eb922-a1c8-456c-b8ae-6843685ae68f {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:31:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] snapshot_file for this snap is: volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:31:01 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea771459-d036-473c-a969-5cdd14965fd9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:31:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:01 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd Jun 01 09:31:01 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:02 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd" returned: 0 in 1.151s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-683eb922-a1c8-456c-b8ae-6843685ae68f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:31:02 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e8dc67-9bad-412e-a578-69ac176bf211]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:31:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:02 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f Jun 01 09:31:02 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Flow 'volume_create_manager' (7beb7168-363c-49a4-824f-b779532f81d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6583c8-be2c-4366-8b95-d04471260b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6583c8-be2c-4366-8b95-d04471260b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1198352445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3147f8e1-eda5-4ee1-be1f-4c6e90dcecda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49070df19c23427084d20ba9f0510c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:31:03Z,use_quota=True,user_id='88d5582045ef44f7997a5e962f0579c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b837d8c-a0e1-403d-91a5-fbfafae24bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b837d8c-a0e1-403d-91a5-fbfafae24bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5a0173-df05-4682-ba94-cdc5f0a1ab0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5a0173-df05-4682-ba94-cdc5f0a1ab0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3147f8e1-eda5-4ee1-be1f-4c6e90dcecda', 'volume_name': 'volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f19343-7218-4bf0-8aaa-1317a8d5cc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f19343-7218-4bf0-8aaa-1317a8d5cc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5270cae9-75a8-47d0-bb9b-44d321375b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:03 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Volume 3147f8e1-eda5-4ee1-be1f-4c6e90dcecda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda', 'volume_size': 1} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1198352445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3147f8e1-eda5-4ee1-be1f-4c6e90dcecda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49070df19c23427084d20ba9f0510c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:31:03Z,use_quota=True,user_id='88d5582045ef44f7997a5e962f0579c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Creating volume 3147f8e1-eda5-4ee1-be1f-4c6e90dcecda {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:31:03 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:03 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda 1073741824 Jun 01 09:31:03 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:03 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f" returned: 0 in 1.257s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:03 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd Jun 01 09:31:03 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:04 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd" returned: 0 in 1.143s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:05 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd Jun 01 09:31:05 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:05 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda 1073741824" returned: 0 in 1.599s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:05 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda Jun 01 09:31:05 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:05 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f.2ae3bd3d-29ac-46e3-abba-5547b25967cd" returned: 0 in 1.025s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "cinder-quobyte-2ae3bd3d-29ac-46e3-abba-5547b25967cd" released by "_delete_snapshot" :: held 4.772s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "cinder-quobyte-683eb922-a1c8-456c-b8ae-6843685ae68f" released by "delete_snapshot" :: held 4.813s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:31:06 devstack cinder-volume[86649]: WARNING cinder.quota [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Created reservations ['9be8e3b5-07b5-4bb4-bedc-e38d52e1e5fb', '571ba39c-0165-445f-a02a-778ae171dbd9', 'e257e4e2-1255-4f84-b873-b449de3d60af', '4f267e55-a7ea-4a9f-9344-42bbda141d6a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:31:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Delete snapshot completed successfully. Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cae4a27-09db-4762-8628-d044a85848ce tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "cinder-2ae3bd3d-29ac-46e3-abba-5547b25967cd-delete_snapshot" released by "delete_snapshot" :: held 5.065s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:31:06 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda" returned: 0 in 1.096s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] <== create_volume: return (2821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.824s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5270cae9-75a8-47d0-bb9b-44d321375b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8e2bbe-9a6b-4d33-87a0-bba6f4b61209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:06 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Volume volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda (3147f8e1-eda5-4ee1-be1f-4c6e90dcecda): created successfully Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8e2bbe-9a6b-4d33-87a0-bba6f4b61209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Flow 'volume_create_manager' (7beb7168-363c-49a4-824f-b779532f81d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:31:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fe14d6ba-7716-47a2-a23d-2792e4f951f5 tempest-ServerRescueNegativeTestJSON-1316434377 None] Created volume successfully. Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Acquiring lock "cinder-683eb922-a1c8-456c-b8ae-6843685ae68f-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "cinder-683eb922-a1c8-456c-b8ae-6843685ae68f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:31:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Acquiring lock "cinder-quobyte-683eb922-a1c8-456c-b8ae-6843685ae68f" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:31:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "cinder-quobyte-683eb922-a1c8-456c-b8ae-6843685ae68f" acquired by "delete_volume" :: waited 0.040s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:31:07 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[195ea2c9-ce81-4f77-9b6a-b7a29d1382b4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:31:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:07 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f Jun 01 09:31:07 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:08 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f" returned: 0 in 0.937s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:08 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f Jun 01 09:31:08 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:09 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-683eb922-a1c8-456c-b8ae-6843685ae68f" returned: 0 in 1.092s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "cinder-quobyte-683eb922-a1c8-456c-b8ae-6843685ae68f" released by "delete_volume" :: held 2.159s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:31:09 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Created reservations ['1e3792ff-1411-45de-a2b2-3141672daf6d', '7e349683-e459-4922-978f-04e424ce21a4', '754cad9b-f285-4b4f-84f5-8a2ba22a3dbb', '69e731b0-7d7d-4585-ad28-70d54ee3fe09'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:31:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:31:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:31:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:31:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:31:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:31:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:09 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:31:09 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:10 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.959s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:31:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Deleted volume successfully. Jun 01 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0d06c7db-777a-4080-b8e9-537489bb07ad tempest-VolumesSnapshotNegativeTestJSON-755239347 None] Lock "cinder-683eb922-a1c8-456c-b8ae-6843685ae68f-delete_volume" released by "delete_volume" :: held 3.470s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Flow 'volume_create_manager' (20861e65-3e0f-43e4-a888-594c9c6ab3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47437511-cb79-4c89-81bc-2b31601c47b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47437511-cb79-4c89-81bc-2b31601c47b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-765518708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e98468-046c-4ac9-a997-c4936266c4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3381bf5965304ef3b47fb37207e053a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:31:15Z,use_quota=True,user_id='de79a0af03a54069b53058033b09bad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2171e3df-0ddc-422c-8577-a03c0725165e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2171e3df-0ddc-422c-8577-a03c0725165e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431ba1f5-058d-422b-8bef-9295257493d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431ba1f5-058d-422b-8bef-9295257493d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e98468-046c-4ac9-a997-c4936266c4fc', 'volume_name': 'volume-52e98468-046c-4ac9-a997-c4936266c4fc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78808cd-e4cd-4643-b35c-19beca983448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78808cd-e4cd-4643-b35c-19beca983448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19be5529-ebe1-45ab-904c-d800539aa2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:14 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Volume 52e98468-046c-4ac9-a997-c4936266c4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e98468-046c-4ac9-a997-c4936266c4fc', 'volume_size': 1} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-765518708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e98468-046c-4ac9-a997-c4936266c4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3381bf5965304ef3b47fb37207e053a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:31:15Z,use_quota=True,user_id='de79a0af03a54069b53058033b09bad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Creating volume 52e98468-046c-4ac9-a997-c4936266c4fc {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:31:14 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:31:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:14 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc 1073741824 Jun 01 09:31:14 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:15 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc 1073741824" returned: 0 in 0.888s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:15 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc Jun 01 09:31:15 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:16 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc" returned: 0 in 0.634s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:31:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:31:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19be5529-ebe1-45ab-904c-d800539aa2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e98468-046c-4ac9-a997-c4936266c4fc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db244d75-00e2-4baa-bcea-b9e7ab853a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:16 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Volume volume-52e98468-046c-4ac9-a997-c4936266c4fc (52e98468-046c-4ac9-a997-c4936266c4fc): created successfully Jun 01 09:31:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db244d75-00e2-4baa-bcea-b9e7ab853a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Flow 'volume_create_manager' (20861e65-3e0f-43e4-a888-594c9c6ab3a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:31:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-47e246ff-5a88-4ee9-824b-c07663b81f00 req-ab845108-15a6-41d3-bab8-bff2fe243d3f tempest-VolumesSnapshotsTestJSON-1409977180 None] Created volume successfully. Jun 01 09:31:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:31:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:31:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] Creating offline snapshot edca720e-8684-478f-9e39-0d0219acb5d8 of volume 52e98468-046c-4ac9-a997-c4936266c4fc {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:31:17 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd7041c-4f95-476b-8d67-99cf66943a94]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:31:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:17 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc Jun 01 09:31:17 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:18 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc" returned: 0 in 1.048s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:18 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 1G Jun 01 09:31:18 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:19 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 1G" returned: 0 in 0.986s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e98468-046c-4ac9-a997-c4936266c4fc -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:19 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e98468-046c-4ac9-a997-c4936266c4fc -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 Jun 01 09:31:19 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:20 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e98468-046c-4ac9-a997-c4936266c4fc -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8" returned: 0 in 1.029s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:20 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 is being set with open permissions: ugo+rw Jun 01 09:31:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:20 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 Jun 01 09:31:20 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:21 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8" returned: 0 in 0.917s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:21 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.info Jun 01 09:31:21 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:22 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.info" returned: 0 in 1.093s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:22 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.info is being set with open permissions: ugo+rw Jun 01 09:31:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:22 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.info Jun 01 09:31:22 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:23 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.info" returned: 0 in 0.937s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.177s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:31:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-aa8948d8-174b-47ef-baff-6ab98a14e997 req-b3b7e562-0043-4b2e-ac09-62d7e76a9f8b tempest-VolumesSnapshotsTestJSON-1409977180 None] Create snapshot completed successfully Jun 01 09:31:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Acquiring lock "cinder-edca720e-8684-478f-9e39-0d0219acb5d8-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:31:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "cinder-edca720e-8684-478f-9e39-0d0219acb5d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:31:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Acquiring lock "cinder-quobyte-52e98468-046c-4ac9-a997-c4936266c4fc" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:31:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "cinder-quobyte-52e98468-046c-4ac9-a997-c4936266c4fc" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:31:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Acquiring lock "cinder-quobyte-edca720e-8684-478f-9e39-0d0219acb5d8" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:31:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "cinder-quobyte-edca720e-8684-478f-9e39-0d0219acb5d8" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:31:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Deleting offline snapshot edca720e-8684-478f-9e39-0d0219acb5d8 of volume 52e98468-046c-4ac9-a997-c4936266c4fc {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:31:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] snapshot_file for this snap is: volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:31:24 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b8a197-3d8b-428a-861b-ec7fd490d04b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:31:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:25 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 Jun 01 09:31:25 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:25 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8" returned: 0 in 0.867s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52e98468-046c-4ac9-a997-c4936266c4fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:31:25 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fd8a7b-9286-4325-addc-bcd2d4e0b907]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:31:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:25 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc Jun 01 09:31:25 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:26 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc" returned: 0 in 0.863s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:26 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 Jun 01 09:31:26 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Acquiring lock "cinder-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:31:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Lock "cinder-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:31:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Acquiring lock "cinder-quobyte-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:31:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Lock "cinder-quobyte-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:31:27 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[629c6881-88cb-46a2-bc77-7858ba051328]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:31:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:27 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8" returned: 0 in 1.166s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:27 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda Jun 01 09:31:27 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8 Jun 01 09:31:27 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:27 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:28 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc.edca720e-8684-478f-9e39-0d0219acb5d8" returned: 0 in 0.988s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "cinder-quobyte-edca720e-8684-478f-9e39-0d0219acb5d8" released by "_delete_snapshot" :: held 4.063s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:31:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "cinder-quobyte-52e98468-046c-4ac9-a997-c4936266c4fc" released by "delete_snapshot" :: held 4.124s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:31:28 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda" returned: 0 in 1.326s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:28 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda Jun 01 09:31:28 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:29 devstack cinder-volume[86649]: DEBUG cinder.quota [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Created reservations ['4c3b0dca-0157-4cfd-8273-ba5b1f0ea366', 'd63c37e7-339a-49e3-91c6-fffd95a960ee', '3e823fa1-00de-47ac-89f4-c27a9d2a7bb3', '682f417b-2d25-4236-87a3-eaa7c42787e8'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:31:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Delete snapshot completed successfully. Jun 01 09:31:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-9a3ed891-0933-4dab-bfb9-23e796156eff req-29a7872e-1fe7-43f3-8bc0-8690822f0fad tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "cinder-edca720e-8684-478f-9e39-0d0219acb5d8-delete_snapshot" released by "delete_snapshot" :: held 4.369s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:31:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Acquiring lock "cinder-52e98468-046c-4ac9-a997-c4936266c4fc-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:31:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "cinder-52e98468-046c-4ac9-a997-c4936266c4fc-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:31:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Acquiring lock "cinder-quobyte-52e98468-046c-4ac9-a997-c4936266c4fc" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:31:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "cinder-quobyte-52e98468-046c-4ac9-a997-c4936266c4fc" acquired by "delete_volume" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:31:29 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0162696-3e51-4eaa-93cb-6e945d9ecd1f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:31:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:29 devstack sudo[91553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc Jun 01 09:31:29 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:29 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda" returned: 0 in 0.942s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Lock "cinder-quobyte-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda" released by "delete_volume" :: held 2.328s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:31:29 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Created reservations ['1901010f-b5f8-42b2-b244-cdb8c21cedd8', 'bf23855b-994c-496f-903d-51ad67a8b256', '6f558e1e-c1cc-4c1e-8e5d-2da7f91ab620', '2abebd98-bd6c-4cec-aa54-f75c77ea7822'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:31:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:31:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:31:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:31:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:31:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:31:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:30 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:31:30 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:30 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc" returned: 0 in 1.022s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:30 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc Jun 01 09:31:30 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:31 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.006s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:31 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:31:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Deleted volume successfully. Jun 01 09:31:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d7da0799-42c1-417d-858b-9edc608ff3b7 tempest-ServerRescueNegativeTestJSON-1316434377 None] Lock "cinder-3147f8e1-eda5-4ee1-be1f-4c6e90dcecda-delete_volume" released by "delete_volume" :: held 3.634s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:31:31 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-52e98468-046c-4ac9-a997-c4936266c4fc" returned: 0 in 0.814s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "cinder-quobyte-52e98468-046c-4ac9-a997-c4936266c4fc" released by "delete_volume" :: held 1.924s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:31:31 devstack cinder-volume[86649]: DEBUG cinder.quota [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Created reservations ['916b6383-396d-4f15-a8b9-bd2ab093cd5c', '45c3dfc3-5011-4ce8-89d2-b8525de13973', '7f88c3d1-a49a-48c3-8b28-6d4fa6735341', '917d16a0-5618-4524-b5b9-3bbb5b807dd4'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:31:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:31:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:31:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:31:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:31:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:31:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:31 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:31:31 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:32 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.757s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:32 devstack cinder-volume[86649]: DEBUG cinder.manager [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:31:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Deleted volume successfully. Jun 01 09:31:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-fee4186a-4138-4008-b1f4-63f811649bb3 req-6ec719c0-93ba-4eae-a71a-a5ebabe974c1 tempest-VolumesSnapshotsTestJSON-1409977180 None] Lock "cinder-52e98468-046c-4ac9-a997-c4936266c4fc-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:31:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:31:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:31:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:31:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:31:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:31:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:31:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:36 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:31:36 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:38 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.329s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:31:41 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=53,cinder:SELECT=39,cinder:DELETE=5,cinder:INSERT=16 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:31:42 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=48,cinder:INSERT=13,cinder:UPDATE=56,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:31:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-994f188b-6348-4199-a012-ecccdd0e25c6 tempest-GroupsV314Test-529652002 None] Group tempest-GroupsV314Test-Group-488207134: creating Jun 01 09:31:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-994f188b-6348-4199-a012-ecccdd0e25c6 tempest-GroupsV314Test-529652002 None] Group tempest-GroupsV314Test-Group-488207134: created successfully Jun 01 09:31:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-994f188b-6348-4199-a012-ecccdd0e25c6 tempest-GroupsV314Test-529652002 None] Create group completed successfully. Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Flow 'volume_create_manager' (2e41c968-4edb-4dc3-8e96-2a1789bb7469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce2d880-d984-4aed-8404-3be302931167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce2d880-d984-4aed-8404-3be302931167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1968382031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2efe34dc-e769-4e76-b4bf-f393559f8293,host='devstack@QuobyteHD#QuobyteHD',id=43f102e3-d794-43b5-b472-98e90039169c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904106d95d5b4b6e8776b578a66d8665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:31:46Z,use_quota=True,user_id='d5a11cc2f67d4ac5ab1a742a1ed74818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(063500b5-1e38-49f8-8d84-bae2cf3b641c),volume_type_id=063500b5-1e38-49f8-8d84-bae2cf3b641c)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0beb6e1-f9db-43a1-b635-d029ff7adeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0beb6e1-f9db-43a1-b635-d029ff7adeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa9cbb5-7626-4273-841a-2b3d839219ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa9cbb5-7626-4273-841a-2b3d839219ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f102e3-d794-43b5-b472-98e90039169c', 'volume_name': 'volume-43f102e3-d794-43b5-b472-98e90039169c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a635656c-c3e9-4971-936e-50940f90ad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a635656c-c3e9-4971-936e-50940f90ad6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8082f7f-33a1-4846-b177-ac0df7e6298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:46 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Volume 43f102e3-d794-43b5-b472-98e90039169c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f102e3-d794-43b5-b472-98e90039169c', 'volume_size': 1} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2efe34dc-e769-4e76-b4bf-f393559f8293,created_at=2026-06-01T07:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1968382031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2efe34dc-e769-4e76-b4bf-f393559f8293,host='devstack@QuobyteHD#QuobyteHD',id=43f102e3-d794-43b5-b472-98e90039169c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904106d95d5b4b6e8776b578a66d8665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:31:46Z,use_quota=True,user_id='d5a11cc2f67d4ac5ab1a742a1ed74818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(063500b5-1e38-49f8-8d84-bae2cf3b641c),volume_type_id=063500b5-1e38-49f8-8d84-bae2cf3b641c)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Creating volume 43f102e3-d794-43b5-b472-98e90039169c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:31:46 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:46 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c 1073741824 Jun 01 09:31:46 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:46 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c 1073741824" returned: 0 in 0.800s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:47 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c Jun 01 09:31:47 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:47 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c" returned: 0 in 0.626s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:31:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:31:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8082f7f-33a1-4846-b177-ac0df7e6298e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f102e3-d794-43b5-b472-98e90039169c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb04ff16-e407-45bf-b659-f7cb493a088d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:31:47 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Volume volume-43f102e3-d794-43b5-b472-98e90039169c (43f102e3-d794-43b5-b472-98e90039169c): created successfully Jun 01 09:31:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb04ff16-e407-45bf-b659-f7cb493a088d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:31:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Flow 'volume_create_manager' (2e41c968-4edb-4dc3-8e96-2a1789bb7469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:31:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7017a78b-1dff-4e1d-b640-02e32f185eac tempest-GroupsV314Test-529652002 None] Created volume successfully. Jun 01 09:31:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:31:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:31:49 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Cloning volume 43f102e3-d794-43b5-b472-98e90039169c to volume f38690dc-2e2b-4d9b-ae58-babc9543f433 Jun 01 09:31:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Creating offline snapshot caaad77c-7895-46a4-88a3-093451ed26ca of volume 43f102e3-d794-43b5-b472-98e90039169c {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:31:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcecb3fa-4551-4ed2-ab9a-6c40be09753d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:31:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:49 devstack sudo[91667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c Jun 01 09:31:49 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:50 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c" returned: 0 in 0.799s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:50 devstack sudo[91673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca 1G Jun 01 09:31:50 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:51 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca 1G" returned: 0 in 1.048s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f102e3-d794-43b5-b472-98e90039169c -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:51 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f102e3-d794-43b5-b472-98e90039169c -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca Jun 01 09:31:51 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:52 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f102e3-d794-43b5-b472-98e90039169c -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca" returned: 0 in 0.728s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:52 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca is being set with open permissions: ugo+rw: NotImplementedError Jun 01 09:31:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:52 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca Jun 01 09:31:52 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:52 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca" returned: 0 in 0.762s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:52 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.info Jun 01 09:31:52 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:53 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.info" returned: 0 in 0.767s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:53 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.info is being set with open permissions: ugo+rw: NotImplementedError Jun 01 09:31:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:53 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.info Jun 01 09:31:53 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:54 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.info" returned: 0 in 0.701s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Acquiring lock "cinder-quobyte-f38690dc-2e2b-4d9b-ae58-babc9543f433" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:31:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Lock "cinder-quobyte-f38690dc-2e2b-4d9b-ae58-babc9543f433" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:31:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] snapshot: caaad77c-7895-46a4-88a3-093451ed26ca, volume: f38690dc-2e2b-4d9b-ae58-babc9543f433, {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 01 09:31:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:31:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:31:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:31:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:31:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:31:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0242da92-4476-4d18-af1e-fc286a8a159b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:31:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:54 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca Jun 01 09:31:54 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:55 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca" returned: 0 in 0.743s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f102e3-d794-43b5-b472-98e90039169c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:31:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 01 09:31:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 01 09:31:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[830dbb7a-e89a-47d4-abfe-18574919a747]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:31:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:55 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c Jun 01 09:31:55 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:31:55 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Jun 01 09:31:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c" returned: 0 in 0.779s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:31:55 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Path /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 01 09:31:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:31:56 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433 Jun 01 09:31:56 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:02 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:32:02 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:INSERT=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:32:04 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433" returned: 0 in 8.210s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[100d1ce7-4016-4edc-99bb-3f7ece65be0a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:04 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c Jun 01 09:32:04 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:05 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c" returned: 0 in 1.167s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:05 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Image conversion details: src /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c, size 1024.00 MB, duration 8.21 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:32:05 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Converted 1024.00 MB image at 124.70 MB/s Jun 01 09:32:05 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433 is being set with open permissions: ugo+rw: NotImplementedError Jun 01 09:32:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:05 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433 Jun 01 09:32:05 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Flow 'volume_create_manager' (4b70c8f8-14a4-4ba4-b1fc-a85ee1ab9115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983e0064-677a-4ac3-bcce-2b0b58dbb31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983e0064-677a-4ac3-bcce-2b0b58dbb31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-260554249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7216e46a40a1478b99ce55bda7889751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:32:06Z,use_quota=True,user_id='839dde29a9cc49e9b9a1c9e631e8bf99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976cbe4c-c6ac-4cf6-9570-bc8db280964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:06 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976cbe4c-c6ac-4cf6-9570-bc8db280964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706e5a13-d232-411d-b1fe-128be26a61e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706e5a13-d232-411d-b1fe-128be26a61e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f', 'volume_name': 'volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12ad804-8d87-4ea2-aa0e-8026253d8685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12ad804-8d87-4ea2-aa0e-8026253d8685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf1d432-1730-4476-9622-9becf4e70d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:06 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Volume 0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f', 'volume_size': 1} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433" returned: 0 in 1.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Lock "cinder-quobyte-f38690dc-2e2b-4d9b-ae58-babc9543f433" released by "_copy_volume_from_snapshot" :: held 12.287s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Acquiring lock "cinder-quobyte-caaad77c-7895-46a4-88a3-093451ed26ca" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Lock "cinder-quobyte-caaad77c-7895-46a4-88a3-093451ed26ca" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Deleting offline snapshot caaad77c-7895-46a4-88a3-093451ed26ca of volume 43f102e3-d794-43b5-b472-98e90039169c {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] snapshot_file for this snap is: volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[387944a7-91f5-45a4-a8fa-c6d8caf17b6a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:06 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca Jun 01 09:32:06 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:08 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca" returned: 0 in 1.317s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f102e3-d794-43b5-b472-98e90039169c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:32:08 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13fe9bd-0b14-4a99-8dd0-a1176712851a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:08 devstack sudo[91881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c Jun 01 09:32:08 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:09 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c" returned: 0 in 0.973s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:09 devstack sudo[91888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca Jun 01 09:32:09 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:10 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca" returned: 0 in 0.937s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:10 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca Jun 01 09:32:10 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:10 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c.caaad77c-7895-46a4-88a3-093451ed26ca" returned: 0 in 0.633s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Lock "cinder-quobyte-caaad77c-7895-46a4-88a3-093451ed26ca" released by "_delete_snapshot" :: held 4.023s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.426s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.113s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-260554249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7216e46a40a1478b99ce55bda7889751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:32:06Z,use_quota=True,user_id='839dde29a9cc49e9b9a1c9e631e8bf99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Creating volume 0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:32:10 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:10 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f 1073741824 Jun 01 09:32:10 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6a1c4d88-b2dc-44d2-a317-e3131fea905d tempest-GroupsV314Test-529652002 None] Create group from source-group-2efe34dc-e769-4e76-b4bf-f393559f8293 completed successfully. Jun 01 09:32:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Acquiring lock "cinder-quobyte-f38690dc-2e2b-4d9b-ae58-babc9543f433" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:32:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Lock "cinder-quobyte-f38690dc-2e2b-4d9b-ae58-babc9543f433" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:32:11 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c189745-edaf-472c-a595-5f1fde754668]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:11 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f 1073741824" returned: 0 in 1.203s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:11 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433 Jun 01 09:32:11 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:12 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f Jun 01 09:32:12 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:12 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433" returned: 0 in 0.834s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:12 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433 Jun 01 09:32:12 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:12 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f" returned: 0 in 0.720s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:32:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf1d432-1730-4476-9622-9becf4e70d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7236c40-b303-45c9-a4a2-47a7b8011d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:12 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Volume volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f (0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f): created successfully Jun 01 09:32:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7236c40-b303-45c9-a4a2-47a7b8011d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Flow 'volume_create_manager' (4b70c8f8-14a4-4ba4-b1fc-a85ee1ab9115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:32:12 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d2e43418-9c39-49e4-84bf-c1ad196bb397 tempest-TestMinimumBasicScenario-1266516776 None] Created volume successfully. Jun 01 09:32:13 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f38690dc-2e2b-4d9b-ae58-babc9543f433" returned: 0 in 0.682s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Lock "cinder-quobyte-f38690dc-2e2b-4d9b-ae58-babc9543f433" released by "delete_volume" :: held 1.578s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:32:13 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Created reservations ['b72245c8-43a6-409f-9f03-f875c7c1486a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:32:13 devstack cinder-volume[86649]: WARNING cinder.quota [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-772964426 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-772964426, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:32:13 devstack cinder-volume[86649]: WARNING cinder.quota [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-772964426 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-772964426, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:32:13 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Created reservations ['3d1266fc-248b-439c-a118-67701a3dcb7f', '50983542-e56f-44d5-8232-f65711a6e6eb', 'db90f6ea-3332-473a-bc55-3b0456a8e69e', '180f1e1f-9dee-4ab9-89e0-b11c0d4e40f2'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:32:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:32:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:32:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:32:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:32:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:13 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:32:13 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Acquiring lock "cinder-quobyte-43f102e3-d794-43b5-b472-98e90039169c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:32:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Lock "cinder-quobyte-43f102e3-d794-43b5-b472-98e90039169c" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:32:14 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca07c21-17b8-4fb8-bada-eb8e0f5c51df]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:14 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.662s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:14 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:32:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-66809288-9078-4266-9dca-4fce4cf8901d tempest-GroupsV314Test-529652002 None] Delete group completed successfully. Jun 01 09:32:14 devstack sudo[91961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c Jun 01 09:32:14 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:15 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c" returned: 0 in 0.761s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:15 devstack sudo[91966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c Jun 01 09:32:15 devstack sudo[91966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:15 devstack sudo[91966]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-43f102e3-d794-43b5-b472-98e90039169c" returned: 0 in 0.639s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Lock "cinder-quobyte-43f102e3-d794-43b5-b472-98e90039169c" released by "delete_volume" :: held 1.468s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:32:15 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Created reservations ['dae94054-7911-482c-883c-7888ebc7ab89'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:32:15 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Created reservations ['b5def091-cbc9-4835-ad0d-3b14f039ac5e', '38c887c4-0bf7-4884-ab4b-0443089e923f', 'cd6d98d8-4380-434a-b2e9-4ab488f0f851', '2f45d118-3115-4f0e-989a-8494eb87b9c3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:32:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:32:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:32:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:32:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:32:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:15 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:32:15 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-bb1c54da-9e48-4b45-b58d-f61f147a0ef3 req-f998923f-ec06-4607-a836-032e5725465a tempest-TestMinimumBasicScenario-1266516776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:32:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-bb1c54da-9e48-4b45-b58d-f61f147a0ef3 req-f998923f-ec06-4607-a836-032e5725465a tempest-TestMinimumBasicScenario-1266516776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:32:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b89b9fa-7632-4c1b-8491-62479c8e3920]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-bb1c54da-9e48-4b45-b58d-f61f147a0ef3 req-f998923f-ec06-4607-a836-032e5725465a tempest-TestMinimumBasicScenario-1266516776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:16 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.664s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:16 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:32:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d74b2a83-a618-417d-9b29-a0524d4aed05 tempest-GroupsV314Test-529652002 None] Delete group completed successfully. Jun 01 09:32:16 devstack sudo[91980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f Jun 01 09:32:16 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:17 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-bb1c54da-9e48-4b45-b58d-f61f147a0ef3 req-f998923f-ec06-4607-a836-032e5725465a tempest-TestMinimumBasicScenario-1266516776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f" returned: 0 in 0.738s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-bb1c54da-9e48-4b45-b58d-f61f147a0ef3 req-f998923f-ec06-4607-a836-032e5725465a tempest-TestMinimumBasicScenario-1266516776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.764s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-bb1c54da-9e48-4b45-b58d-f61f147a0ef3 req-f998923f-ec06-4607-a836-032e5725465a tempest-TestMinimumBasicScenario-1266516776 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4ddd33a-e1fa-439f-9089-af0dc3df97b3', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:32:17 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-bb1c54da-9e48-4b45-b58d-f61f147a0ef3 req-f998923f-ec06-4607-a836-032e5725465a tempest-TestMinimumBasicScenario-1266516776 None] attachment_update completed successfully. Jun 01 09:32:27 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=28,cinder:SELECT=28,cinder:INSERT=5 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:32:27 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=28,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Flow 'volume_create_manager' (7927a8ee-0628-47f0-acfc-b781f700d789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15da69ce-c9da-4587-b6ee-9f322b48ae64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15da69ce-c9da-4587-b6ee-9f322b48ae64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1207790392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e868fe19-c5aa-408d-8442-708d82192993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e74eca599bc41a5bf1dea0772994c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:32:29Z,use_quota=True,user_id='feeacac1272746f191c2aea026205ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db98e18-5b74-42e2-93b7-c1207b56ce13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db98e18-5b74-42e2-93b7-c1207b56ce13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d8b839-36df-4c42-a01a-babb2fd7e299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d8b839-36df-4c42-a01a-babb2fd7e299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e868fe19-c5aa-408d-8442-708d82192993', 'volume_name': 'volume-e868fe19-c5aa-408d-8442-708d82192993', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63b324b-cf25-47e0-af68-aace63bd8a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63b324b-cf25-47e0-af68-aace63bd8a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad594c3-5eba-4ce0-88af-5e33eb1bb352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:29 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Volume e868fe19-c5aa-408d-8442-708d82192993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e868fe19-c5aa-408d-8442-708d82192993', 'volume_size': 1} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1207790392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e868fe19-c5aa-408d-8442-708d82192993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e74eca599bc41a5bf1dea0772994c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:32:29Z,use_quota=True,user_id='feeacac1272746f191c2aea026205ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Creating volume e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:32:29 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:32:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:29 devstack sudo[92463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993 1073741824 Jun 01 09:32:29 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:30 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993 1073741824" returned: 0 in 1.004s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:30 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993 Jun 01 09:32:30 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:31 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993" returned: 0 in 0.602s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:32:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad594c3-5eba-4ce0-88af-5e33eb1bb352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e868fe19-c5aa-408d-8442-708d82192993', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc701a5-2f2e-4d13-8418-8962d9b17130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:31 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Volume volume-e868fe19-c5aa-408d-8442-708d82192993 (e868fe19-c5aa-408d-8442-708d82192993): created successfully Jun 01 09:32:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc701a5-2f2e-4d13-8418-8962d9b17130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Flow 'volume_create_manager' (7927a8ee-0628-47f0-acfc-b781f700d789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:32:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-65b486df-810e-44a4-a7ca-334bdbd5e054 tempest-SnapshotsActionsTest-1037715816 None] Created volume successfully. Jun 01 09:32:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:32:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:32:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] Creating offline snapshot 35db8949-8dd3-4415-94e9-56e072f203ce of volume e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:32:31 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[882fd7d5-6dbd-414b-9823-47bb1f46bb7c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:31 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993 Jun 01 09:32:31 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:32 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993" returned: 0 in 0.856s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:32 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce 1G Jun 01 09:32:32 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:33 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce 1G" returned: 0 in 0.820s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:33 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce Jun 01 09:32:33 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:34 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce" returned: 0 in 0.921s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:34 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce is being set with open permissions: ugo+rw Jun 01 09:32:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:34 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce Jun 01 09:32:34 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:35 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce" returned: 0 in 0.645s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:35 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.info Jun 01 09:32:35 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:35 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.info" returned: 0 in 0.726s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:35 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.info is being set with open permissions: ugo+rw Jun 01 09:32:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:35 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.info Jun 01 09:32:35 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:36 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.info" returned: 0 in 0.755s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.831s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-eeab30e7-04ac-4194-9082-8a625b7e7c4f tempest-SnapshotsActionsTest-1037715816 None] Create snapshot completed successfully Jun 01 09:32:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:32:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:32:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:32:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:32:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:32:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:36 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:32:36 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:37 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.588s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:32:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:32:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:32:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] Creating offline snapshot 8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c of volume e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:32:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe79bf8-3e92-4722-b275-1d511d3b48ec]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:37 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce Jun 01 09:32:37 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:38 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce" returned: 0 in 0.925s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e868fe19-c5aa-408d-8442-708d82192993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:32:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:38 devstack sudo[92560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c 1G Jun 01 09:32:38 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:40 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c 1G" returned: 0 in 1.641s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:40 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c Jun 01 09:32:40 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:40 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c" returned: 0 in 0.803s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:41 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c is being set with open permissions: ugo+rw Jun 01 09:32:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:41 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c Jun 01 09:32:41 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:41 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c" returned: 0 in 0.757s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.237s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-59a4ed4d-4136-4133-8af1-c8cc5c27ca4d tempest-SnapshotsActionsTest-1037715816 None] Create snapshot completed successfully Jun 01 09:32:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Acquiring lock "cinder-8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:32:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:32:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Acquiring lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:32:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:32:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Acquiring lock "cinder-quobyte-8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:32:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:32:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Deleting offline snapshot 8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c of volume e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:32:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] snapshot_file for this snap is: volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:32:43 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a05654-3a1a-4942-b7ac-796c4af6b6d8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:43 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c Jun 01 09:32:43 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:43 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c" returned: 0 in 0.752s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e868fe19-c5aa-408d-8442-708d82192993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:32:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9700d1cf-493c-4672-9b9d-3784d6627f46]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:44 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce Jun 01 09:32:44 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:44 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce" returned: 0 in 0.699s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e868fe19-c5aa-408d-8442-708d82192993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:32:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:44 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c Jun 01 09:32:44 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:45 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c" returned: 0 in 0.715s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:45 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c Jun 01 09:32:45 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:46 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c" returned: 0 in 0.598s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c" released by "_delete_snapshot" :: held 2.865s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:32:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" released by "delete_snapshot" :: held 2.890s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:32:46 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Created reservations ['3de0b0a3-6ad9-40d1-935b-a838c6486927', '81fbae3a-bd43-4489-b846-db8ab1b0fbde', '5978dd63-ba49-4147-8cdc-e23a1d0db3c3', '18346723-5db7-46d9-9a84-e341e5592917'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:32:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Delete snapshot completed successfully. Jun 01 09:32:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-28882182-d45a-459d-aa3f-5e96ef33d909 tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-8c345cc5-d6c4-44ab-a298-5f6b8cb9bf1c-delete_snapshot" released by "delete_snapshot" :: held 3.037s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:32:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:32:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:32:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] Creating offline snapshot 65e63591-c3f0-4267-9f17-62f9accee8eb of volume e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:32:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e876922a-5293-4aad-82db-b6ac4b454035]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:46 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce Jun 01 09:32:46 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:47 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce" returned: 0 in 0.681s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e868fe19-c5aa-408d-8442-708d82192993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:32:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:47 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb 1G Jun 01 09:32:47 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:48 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb 1G" returned: 0 in 0.755s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:48 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb Jun 01 09:32:48 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:48 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb" returned: 0 in 0.650s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:48 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb is being set with open permissions: ugo+rw Jun 01 09:32:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:48 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb Jun 01 09:32:48 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:49 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb" returned: 0 in 0.570s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.751s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-739a9c77-7ef5-40ac-9cda-7864a7817a13 tempest-SnapshotsActionsTest-1037715816 None] Create snapshot completed successfully Jun 01 09:32:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Acquiring lock "cinder-65e63591-c3f0-4267-9f17-62f9accee8eb-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:32:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-65e63591-c3f0-4267-9f17-62f9accee8eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:32:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Acquiring lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:32:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:32:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Acquiring lock "cinder-quobyte-65e63591-c3f0-4267-9f17-62f9accee8eb" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:32:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-65e63591-c3f0-4267-9f17-62f9accee8eb" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:32:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Deleting offline snapshot 65e63591-c3f0-4267-9f17-62f9accee8eb of volume e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:32:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] snapshot_file for this snap is: volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:32:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[11057c99-84b9-49b7-8b8a-a4260dc4b54e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:50 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb Jun 01 09:32:50 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:50 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb" returned: 0 in 0.770s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e868fe19-c5aa-408d-8442-708d82192993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:32:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25cd224-1384-40f3-a214-2fa6e718938e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:50 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce Jun 01 09:32:50 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:51 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce" returned: 0 in 0.758s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e868fe19-c5aa-408d-8442-708d82192993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:32:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:51 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb Jun 01 09:32:51 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:52 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb" returned: 0 in 0.748s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:52 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb Jun 01 09:32:52 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:52 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.65e63591-c3f0-4267-9f17-62f9accee8eb" returned: 0 in 0.625s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-65e63591-c3f0-4267-9f17-62f9accee8eb" released by "_delete_snapshot" :: held 3.043s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:32:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" released by "delete_snapshot" :: held 3.079s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:32:53 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Created reservations ['c12552e7-3345-45f1-b9f5-ec3452c42c15', '0290b84a-268d-4c08-965d-94c34ee8e443', '236c2e3e-8c75-4ad8-bb1c-456d8e56a996', '1f02ee21-6998-463a-8362-0ca54491bc51'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:32:53 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Delete snapshot completed successfully. Jun 01 09:32:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5f12a11-34bb-46c4-922c-8003d70f8328 tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-65e63591-c3f0-4267-9f17-62f9accee8eb-delete_snapshot" released by "delete_snapshot" :: held 3.224s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:32:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:32:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:32:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] Creating offline snapshot 605491c3-101b-4906-aeb9-81d241da21d5 of volume e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:32:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dccfd4b-41c3-4210-bf9f-c48db08e01de]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:54 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce Jun 01 09:32:54 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:55 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce" returned: 0 in 0.755s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e868fe19-c5aa-408d-8442-708d82192993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:55 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 1G Jun 01 09:32:55 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Flow 'volume_create_manager' (18412e70-0a7e-4446-bbed-4dfe6eecb9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a8f1c8-148e-4fd4-a9f2-7a0eb453d6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a8f1c8-148e-4fd4-a9f2-7a0eb453d6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1014887902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df587df9-9cf4-41b5-9d59-2d7a1980e5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a41cecfaca5458883c2ad6c2730235f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:32:55Z,use_quota=True,user_id='51e03ff572ca4be48d978386fa0d1cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0916923c-49c3-41cf-8413-8380c0255a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0916923c-49c3-41cf-8413-8380c0255a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258af767-f6b0-4e71-bbf2-87a5bf5c22b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258af767-f6b0-4e71-bbf2-87a5bf5c22b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df587df9-9cf4-41b5-9d59-2d7a1980e5de', 'volume_name': 'volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf526a7-44df-44e8-b716-b9287753ca0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf526a7-44df-44e8-b716-b9287753ca0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28973241-a3b7-42c9-a3ab-54d1f12bf140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:55 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Volume df587df9-9cf4-41b5-9d59-2d7a1980e5de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de', 'volume_size': 1} Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:32:55 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 1G" returned: 0 in 0.775s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:55 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 Jun 01 09:32:55 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:56 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5" returned: 0 in 0.632s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:56 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 is being set with open permissions: ugo+rw Jun 01 09:32:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:56 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 Jun 01 09:32:56 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:57 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5" returned: 0 in 0.573s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.824s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.844s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1014887902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df587df9-9cf4-41b5-9d59-2d7a1980e5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a41cecfaca5458883c2ad6c2730235f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:32:55Z,use_quota=True,user_id='51e03ff572ca4be48d978386fa0d1cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Creating volume df587df9-9cf4-41b5-9d59-2d7a1980e5de {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:32:57 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:57 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de 1073741824 Jun 01 09:32:57 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fd5ea1d8-7529-462c-8130-770c071dd0c9 tempest-SnapshotsActionsTest-1037715816 None] Create snapshot completed successfully Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Acquiring lock "cinder-605491c3-101b-4906-aeb9-81d241da21d5-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-605491c3-101b-4906-aeb9-81d241da21d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Acquiring lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Acquiring lock "cinder-quobyte-605491c3-101b-4906-aeb9-81d241da21d5" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-605491c3-101b-4906-aeb9-81d241da21d5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Deleting offline snapshot 605491c3-101b-4906-aeb9-81d241da21d5 of volume e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] snapshot_file for this snap is: volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06af031-780c-4230-897c-add6ee01a1b3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:57 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 Jun 01 09:32:57 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:57 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de 1073741824" returned: 0 in 0.775s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:58 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de Jun 01 09:32:58 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:58 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5" returned: 0 in 0.708s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e868fe19-c5aa-408d-8442-708d82192993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:32:58 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5e3ca2-e231-42d9-80a6-27f1646805df]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:32:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:58 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce Jun 01 09:32:58 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:58 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de" returned: 0 in 0.622s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:32:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:32:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28973241-a3b7-42c9-a3ab-54d1f12bf140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb45ffd7-a546-4107-b4f9-1866bc071a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:32:58 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Volume volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de (df587df9-9cf4-41b5-9d59-2d7a1980e5de): created successfully Jun 01 09:32:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb45ffd7-a546-4107-b4f9-1866bc071a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:32:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Flow 'volume_create_manager' (18412e70-0a7e-4446-bbed-4dfe6eecb9b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:32:58 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8a30516d-582b-4fdd-8de9-7818bcd940df tempest-AttachVolumeShelveTestJSON-959099849 None] Created volume successfully. Jun 01 09:32:59 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce" returned: 0 in 0.723s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e868fe19-c5aa-408d-8442-708d82192993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:32:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:59 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 Jun 01 09:32:59 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:32:59 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Jun 01 09:32:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5" returned: 0 in 0.751s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:32:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:32:59 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5 Jun 01 09:32:59 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:00 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.605491c3-101b-4906-aeb9-81d241da21d5" returned: 0 in 0.717s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-605491c3-101b-4906-aeb9-81d241da21d5" released by "_delete_snapshot" :: held 3.010s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" released by "delete_snapshot" :: held 3.033s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:00 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Created reservations ['7bfc9124-cc9b-438d-9abd-a1132f99ff77', 'cc19d21e-27a7-415f-b67f-41e17be518ac', '31a5682a-c0df-4405-82a6-0d0dc80659c2', '41574de5-b0f1-471c-ab78-7e5054728f39'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:33:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Delete snapshot completed successfully. Jun 01 09:33:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3da5e27e-09b8-4c86-a6af-8512ac69cbea tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-605491c3-101b-4906-aeb9-81d241da21d5-delete_snapshot" released by "delete_snapshot" :: held 3.212s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-3cd33905-02ed-4be3-b1e2-2b56f961b72f req-404827a6-8b2d-438a-bfde-10416792b54f tempest-AttachVolumeTestJSON-1055284462 None] Terminate volume connection completed successfully. Jun 01 09:33:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-3cd33905-02ed-4be3-b1e2-2b56f961b72f req-404827a6-8b2d-438a-bfde-10416792b54f tempest-AttachVolumeTestJSON-1055284462 None] Deleting attachment ddafcdae-6d7c-4d0e-8ac1-745209d79f08. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:33:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:33:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:33:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] Creating offline snapshot 8b3a0d6f-599f-4c94-aaac-c05f27497a16 of volume e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:33:02 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f674aaa-5c6c-468c-9fe7-c1029ddb9f6b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:33:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:02 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce Jun 01 09:33:02 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:03 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce" returned: 0 in 1.040s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e868fe19-c5aa-408d-8442-708d82192993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:33:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:03 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 1G Jun 01 09:33:03 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:04 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 1G" returned: 0 in 1.008s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:04 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 Jun 01 09:33:04 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:04 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16" returned: 0 in 0.626s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:04 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 is being set with open permissions: ugo+rw Jun 01 09:33:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:04 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 Jun 01 09:33:04 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:05 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16" returned: 0 in 0.739s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.585s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:33:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8ff898b7-a60e-4dd3-8cd7-c04522b5be3a tempest-SnapshotsActionsTest-1037715816 None] Create snapshot completed successfully Jun 01 09:33:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-43867678-e3d2-424a-a9c7-7f6a7a384b08 req-508c5d39-0b1a-4ded-9293-1a2d0dca2918 tempest-TestMinimumBasicScenario-1266516776 None] Terminate volume connection completed successfully. Jun 01 09:33:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-43867678-e3d2-424a-a9c7-7f6a7a384b08 req-508c5d39-0b1a-4ded-9293-1a2d0dca2918 tempest-TestMinimumBasicScenario-1266516776 None] Deleting attachment f4ddd33a-e1fa-439f-9089-af0dc3df97b3. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:33:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Acquiring lock "cinder-8b3a0d6f-599f-4c94-aaac-c05f27497a16-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:33:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-8b3a0d6f-599f-4c94-aaac-c05f27497a16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:33:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Acquiring lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:33:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:33:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Acquiring lock "cinder-quobyte-8b3a0d6f-599f-4c94-aaac-c05f27497a16" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:33:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-8b3a0d6f-599f-4c94-aaac-c05f27497a16" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:33:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Deleting offline snapshot 8b3a0d6f-599f-4c94-aaac-c05f27497a16 of volume e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:33:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] snapshot_file for this snap is: volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:33:06 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e37852-3396-4530-951f-b66a78962e04]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:33:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:06 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 Jun 01 09:33:06 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:07 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16" returned: 0 in 0.704s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e868fe19-c5aa-408d-8442-708d82192993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:33:07 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[993d7c0d-d7f9-4c89-9765-66a9753ca3b8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:33:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:07 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce Jun 01 09:33:07 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Acquiring lock "cinder-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:33:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Lock "cinder-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:33:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Acquiring lock "cinder-quobyte-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:33:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Lock "cinder-quobyte-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:33:07 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7e33ad-487e-42b1-9165-370759f8dee9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:33:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:08 devstack sudo[92878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f Jun 01 09:33:08 devstack sudo[92878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:08 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce" returned: 0 in 0.973s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e868fe19-c5aa-408d-8442-708d82192993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:33:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:08 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 Jun 01 09:33:08 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:08 devstack sudo[92878]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f" returned: 0 in 0.984s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:09 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f Jun 01 09:33:09 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:09 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16" returned: 0 in 0.938s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:09 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16 Jun 01 09:33:09 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:09 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f" returned: 0 in 0.638s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Lock "cinder-quobyte-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f" released by "delete_volume" :: held 1.668s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Created reservations ['29897b69-1c3e-4d30-846c-0bd7cc0a5a21', 'baf3e7dc-8cdd-4350-a7fb-d5b6f9c6ef62', '5b32e81a-ea55-408e-86c4-167ef1a9f25d', '81cc762b-c48e-4289-aa6b-904e54411e73'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:09 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:33:09 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:09 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.8b3a0d6f-599f-4c94-aaac-c05f27497a16" returned: 0 in 0.625s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-8b3a0d6f-599f-4c94-aaac-c05f27497a16" released by "_delete_snapshot" :: held 3.340s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" released by "delete_snapshot" :: held 3.367s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:09 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Created reservations ['de139954-2ee9-4739-b544-e4a44ec7c07c', '168e030d-b8af-49ee-b532-b29e67f60436', '207b0ffe-c96f-473d-8b80-2400deda6719', 'ba2341f5-5d94-4f8e-84b1-8f5f9d427525'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:33:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Delete snapshot completed successfully. Jun 01 09:33:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d610f84-db92-4bbe-9da6-10bcc6872c0e tempest-SnapshotsActionsTest-1778917709 None] Lock "cinder-8b3a0d6f-599f-4c94-aaac-c05f27497a16-delete_snapshot" released by "delete_snapshot" :: held 3.516s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:10 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.593s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:10 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:33:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Deleted volume successfully. Jun 01 09:33:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a56d2d40-2b74-418e-a08e-0ac5a785d348 tempest-TestMinimumBasicScenario-1266516776 None] Lock "cinder-0ed5a8c3-7e74-4b25-83cd-c49bc362cd0f-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Acquiring lock "cinder-35db8949-8dd3-4415-94e9-56e072f203ce-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:33:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Lock "cinder-35db8949-8dd3-4415-94e9-56e072f203ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:33:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Acquiring lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:33:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:33:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Acquiring lock "cinder-quobyte-35db8949-8dd3-4415-94e9-56e072f203ce" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:33:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Lock "cinder-quobyte-35db8949-8dd3-4415-94e9-56e072f203ce" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:33:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Deleting offline snapshot 35db8949-8dd3-4415-94e9-56e072f203ce of volume e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:33:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] snapshot_file for this snap is: volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:33:11 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62fc282-20f6-42e3-b623-d1c8758c61d4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:33:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:11 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce Jun 01 09:33:11 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:12 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce" returned: 0 in 1.063s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e868fe19-c5aa-408d-8442-708d82192993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:33:12 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d9b140-9aa2-4800-9884-165cc5393995]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:33:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:12 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993 Jun 01 09:33:12 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:13 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993" returned: 0 in 0.863s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:13 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce Jun 01 09:33:13 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:14 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce" returned: 0 in 0.816s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:14 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce Jun 01 09:33:14 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:14 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993.35db8949-8dd3-4415-94e9-56e072f203ce" returned: 0 in 0.764s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Lock "cinder-quobyte-35db8949-8dd3-4415-94e9-56e072f203ce" released by "_delete_snapshot" :: held 3.697s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" released by "delete_snapshot" :: held 3.729s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:14 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Created reservations ['3eee38e0-b1b9-4eb7-9dbe-a20d59b8b32d', 'd3e0c351-745b-403d-a587-dc730e8ed973', '0258aeb3-722c-428a-ae2e-872f546d9fa6', '2f42dd3b-5a52-4c4b-aabe-ca278a8eaf55'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:33:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Delete snapshot completed successfully. Jun 01 09:33:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0297df05-3387-401a-9b3f-ba53c3c15355 tempest-SnapshotsActionsTest-1037715816 None] Lock "cinder-35db8949-8dd3-4415-94e9-56e072f203ce-delete_snapshot" released by "delete_snapshot" :: held 3.883s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Acquiring lock "cinder-e868fe19-c5aa-408d-8442-708d82192993-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:33:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Lock "cinder-e868fe19-c5aa-408d-8442-708d82192993-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:33:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Acquiring lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:33:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:33:15 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a0ba54-0b22-4a3e-b9f3-d4a458e26c75]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:33:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:15 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993 Jun 01 09:33:15 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:16 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993" returned: 0 in 0.786s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:16 devstack sudo[93033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993 Jun 01 09:33:16 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:17 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e868fe19-c5aa-408d-8442-708d82192993" returned: 0 in 0.697s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Lock "cinder-quobyte-e868fe19-c5aa-408d-8442-708d82192993" released by "delete_volume" :: held 1.564s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:17 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Created reservations ['25f6ccc0-732f-4e76-93f3-11622b10fda6', '87bdd036-fec7-4360-8cd0-880368db5899', '4fbf4dc0-aaf5-4650-90fb-474889441ad1', '5163f01e-4cb3-4f89-8724-60244b3c6041'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:33:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:33:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:33:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:33:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:33:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:33:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:17 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:33:17 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:17 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.575s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:17 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:33:17 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Deleted volume successfully. Jun 01 09:33:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3bef6acb-1b38-4ccf-87a1-ef481562fbc2 tempest-SnapshotsActionsTest-1037715816 None] Lock "cinder-e868fe19-c5aa-408d-8442-708d82192993-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-2a816af0-2cc5-4797-88ff-a025ec2b9dcb req-89c27e38-119a-461b-b65a-7e3ca49141d7 tempest-AttachVolumeShelveTestJSON-959099849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:33:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-2a816af0-2cc5-4797-88ff-a025ec2b9dcb req-89c27e38-119a-461b-b65a-7e3ca49141d7 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:33:19 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[097203da-51ff-4b06-8961-eead918a80fe]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:33:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-2a816af0-2cc5-4797-88ff-a025ec2b9dcb req-89c27e38-119a-461b-b65a-7e3ca49141d7 tempest-AttachVolumeShelveTestJSON-959099849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:19 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de Jun 01 09:33:19 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:20 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-2a816af0-2cc5-4797-88ff-a025ec2b9dcb req-89c27e38-119a-461b-b65a-7e3ca49141d7 tempest-AttachVolumeShelveTestJSON-959099849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de" returned: 0 in 0.848s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-2a816af0-2cc5-4797-88ff-a025ec2b9dcb req-89c27e38-119a-461b-b65a-7e3ca49141d7 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.871s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:33:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-2a816af0-2cc5-4797-88ff-a025ec2b9dcb req-89c27e38-119a-461b-b65a-7e3ca49141d7 tempest-AttachVolumeShelveTestJSON-959099849 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b69ae0a-a4e1-4a49-b323-ab25740e19db', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:33:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-2a816af0-2cc5-4797-88ff-a025ec2b9dcb req-89c27e38-119a-461b-b65a-7e3ca49141d7 tempest-AttachVolumeShelveTestJSON-959099849 None] attachment_update completed successfully. Jun 01 09:33:30 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=56,cinder:SELECT=63,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:33:30 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=54,cinder:UPDATE=57,cinder:DELETE=4,cinder:INSERT=15 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:33:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:33:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:33:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:33:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:33:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:33:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:33:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:36 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:33:36 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:37 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.030s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Flow 'volume_create_manager' (1cc17fb5-e826-4207-9c83-6154680a94d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7cb808-f18f-4418-8e48-67a1467e3aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7cb808-f18f-4418-8e48-67a1467e3aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1409185385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d270f30-1e38-48c5-b277-b1b0c1713a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17297f7bf37040b3a96485ed1dfbc9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:33:49Z,use_quota=True,user_id='4eb1dc3b78a149e7a3832dcdd6bd74e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f1a98b-faa2-4522-a3ce-809901d87e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f1a98b-faa2-4522-a3ce-809901d87e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4fbb8a-a055-4b06-ae94-89cbfac60aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4fbb8a-a055-4b06-ae94-89cbfac60aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d270f30-1e38-48c5-b277-b1b0c1713a31', 'volume_name': 'volume-9d270f30-1e38-48c5-b277-b1b0c1713a31', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6825eb-7b0f-4cb2-b478-4dada4363ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6825eb-7b0f-4cb2-b478-4dada4363ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d8cbc03-3c9b-49be-9ce8-4e30d0371172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:49 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Volume 9d270f30-1e38-48c5-b277-b1b0c1713a31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d270f30-1e38-48c5-b277-b1b0c1713a31', 'volume_size': 1} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1409185385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d270f30-1e38-48c5-b277-b1b0c1713a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17297f7bf37040b3a96485ed1dfbc9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:33:49Z,use_quota=True,user_id='4eb1dc3b78a149e7a3832dcdd6bd74e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Creating volume 9d270f30-1e38-48c5-b277-b1b0c1713a31 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:33:49 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d270f30-1e38-48c5-b277-b1b0c1713a31 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:49 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d270f30-1e38-48c5-b277-b1b0c1713a31 1073741824 Jun 01 09:33:49 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:49 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d270f30-1e38-48c5-b277-b1b0c1713a31 1073741824" returned: 0 in 0.807s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d270f30-1e38-48c5-b277-b1b0c1713a31 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:50 devstack sudo[93670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d270f30-1e38-48c5-b277-b1b0c1713a31 Jun 01 09:33:50 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:50 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d270f30-1e38-48c5-b277-b1b0c1713a31" returned: 0 in 0.646s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:33:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:33:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d8cbc03-3c9b-49be-9ce8-4e30d0371172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d270f30-1e38-48c5-b277-b1b0c1713a31', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77193a46-073a-4b8e-9393-cde5ba7a260f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:50 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Volume volume-9d270f30-1e38-48c5-b277-b1b0c1713a31 (9d270f30-1e38-48c5-b277-b1b0c1713a31): created successfully Jun 01 09:33:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77193a46-073a-4b8e-9393-cde5ba7a260f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Flow 'volume_create_manager' (1cc17fb5-e826-4207-9c83-6154680a94d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:33:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d748737a-eea7-4fd6-869f-a14c8486361f tempest-VolumesTransfersV355Test-1562329370 None] Created volume successfully. Jun 01 09:33:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-bf997ffa-5e1b-40b2-ba85-6137f82d4a6c tempest-VolumesTransfersV355Test-8248678 None] Transfer volume completed successfully. Jun 01 09:33:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Acquiring lock "cinder-9d270f30-1e38-48c5-b277-b1b0c1713a31-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:33:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Lock "cinder-9d270f30-1e38-48c5-b277-b1b0c1713a31-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:33:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Acquiring lock "cinder-quobyte-9d270f30-1e38-48c5-b277-b1b0c1713a31" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:33:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Lock "cinder-quobyte-9d270f30-1e38-48c5-b277-b1b0c1713a31" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:33:53 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af31688-ef72-4659-b89a-410914084dae]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:33:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d270f30-1e38-48c5-b277-b1b0c1713a31 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:53 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d270f30-1e38-48c5-b277-b1b0c1713a31 Jun 01 09:33:53 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:54 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d270f30-1e38-48c5-b277-b1b0c1713a31" returned: 0 in 1.553s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d270f30-1e38-48c5-b277-b1b0c1713a31 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:54 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d270f30-1e38-48c5-b277-b1b0c1713a31 Jun 01 09:33:54 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:55 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d270f30-1e38-48c5-b277-b1b0c1713a31" returned: 0 in 0.748s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Lock "cinder-quobyte-9d270f30-1e38-48c5-b277-b1b0c1713a31" released by "delete_volume" :: held 2.371s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:55 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Created reservations ['106c37e4-fa55-414b-9cce-a7c48ef6eb42', 'dcdf3bda-f305-4245-bce4-1eb3a64a6570', 'dd4b8884-4c86-4517-a15c-3bd0db97c6dc', 'e100acc7-1962-407a-b583-e714826c7464'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:33:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:33:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:33:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:33:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:33:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:33:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:55 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:33:55 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Flow 'volume_create_manager' (e8ce58de-ee51-4d95-bdc6-f852049d182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6254356-b17e-47e8-bf0b-1b2921288148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6254356-b17e-47e8-bf0b-1b2921288148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1996814169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17297f7bf37040b3a96485ed1dfbc9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:33:57Z,use_quota=True,user_id='4eb1dc3b78a149e7a3832dcdd6bd74e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24261021-18fa-40be-9f8f-c44a862a791e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24261021-18fa-40be-9f8f-c44a862a791e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff54650d-912c-4ebc-819d-92d832e0bcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff54650d-912c-4ebc-819d-92d832e0bcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11', 'volume_name': 'volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bfc7ac-f54e-40d9-844d-84fcda770cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bfc7ac-f54e-40d9-844d-84fcda770cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e99d3f-8e00-458e-accf-53c5e863a3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:56 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Volume a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11', 'volume_size': 1} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1996814169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17297f7bf37040b3a96485ed1dfbc9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:33:57Z,use_quota=True,user_id='4eb1dc3b78a149e7a3832dcdd6bd74e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Creating volume a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:33:56 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:56 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:56 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11 1073741824 Jun 01 09:33:56 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.020s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:33:56 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Deleted volume successfully. Jun 01 09:33:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0f0a44ee-f37a-438f-a57d-7ce878e12c01 tempest-VolumesTransfersV355Test-1555037281 None] Lock "cinder-9d270f30-1e38-48c5-b277-b1b0c1713a31-delete_volume" released by "delete_volume" :: held 3.767s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:33:57 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:33:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Flow 'volume_create_manager' (43851b51-b81e-4c6a-b18f-1f5e851b2bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:33:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8b0102-da62-4a18-9d71-218c9982160f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8b0102-da62-4a18-9d71-218c9982160f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-957840287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afaa2423-4c35-4ace-bd20-6b05b27485d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae848e9102940c092d4e8bbced46e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:33:57Z,use_quota=True,user_id='1271b039186f46efb79203f5db531851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee71a38-3a19-4003-b5c9-515f6c3eafa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee71a38-3a19-4003-b5c9-515f6c3eafa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a95580-9379-4257-b8a0-e8a145c9fe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a95580-9379-4257-b8a0-e8a145c9fe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afaa2423-4c35-4ace-bd20-6b05b27485d4', 'volume_name': 'volume-afaa2423-4c35-4ace-bd20-6b05b27485d4', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43cb55a-c265-4f59-a772-09b6eaf3275d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43cb55a-c265-4f59-a772-09b6eaf3275d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4231ee04-1f7b-47de-ab12-36720fba3cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:57 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Volume afaa2423-4c35-4ace-bd20-6b05b27485d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afaa2423-4c35-4ace-bd20-6b05b27485d4', 'volume_size': 1} Jun 01 09:33:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:33:57 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11 1073741824" returned: 0 in 1.061s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:57 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11 Jun 01 09:33:57 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:58 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11" returned: 0 in 0.707s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.862s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-957840287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afaa2423-4c35-4ace-bd20-6b05b27485d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae848e9102940c092d4e8bbced46e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:33:57Z,use_quota=True,user_id='1271b039186f46efb79203f5db531851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Creating volume afaa2423-4c35-4ace-bd20-6b05b27485d4 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:33:58 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:58 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4 1073741824 Jun 01 09:33:58 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e99d3f-8e00-458e-accf-53c5e863a3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d4a74e-9a7c-41e7-bb51-c77341c27c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:33:58 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Volume volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11 (a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11): created successfully Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d4a74e-9a7c-41e7-bb51-c77341c27c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:33:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Flow 'volume_create_manager' (e8ce58de-ee51-4d95-bdc6-f852049d182d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:33:58 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cd29b6ea-5541-4082-972f-0c0986861820 tempest-VolumesTransfersV355Test-1562329370 None] Created volume successfully. Jun 01 09:33:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Acquiring lock "cinder-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:33:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Lock "cinder-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:33:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Acquiring lock "cinder-quobyte-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:33:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Lock "cinder-quobyte-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:33:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a014eb-36ff-44f0-ad44-d0789154a12c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:33:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:59 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11 Jun 01 09:33:59 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:33:59 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Jun 01 09:33:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4 1073741824" returned: 0 in 0.869s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:33:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:33:59 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4 Jun 01 09:33:59 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:00 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11" returned: 0 in 0.860s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:00 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4" returned: 0 in 0.663s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:00 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11 Jun 01 09:34:00 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4231ee04-1f7b-47de-ab12-36720fba3cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afaa2423-4c35-4ace-bd20-6b05b27485d4', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90ef4d4-6ee9-4865-bfd1-f76cd0b69964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:00 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Volume volume-afaa2423-4c35-4ace-bd20-6b05b27485d4 (afaa2423-4c35-4ace-bd20-6b05b27485d4): created successfully Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90ef4d4-6ee9-4865-bfd1-f76cd0b69964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Flow 'volume_create_manager' (43851b51-b81e-4c6a-b18f-1f5e851b2bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:34:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8d42bac8-e32c-4f71-a474-dba4b5c416b5 tempest-AttachVolumeTestJSON-1055284462 None] Created volume successfully. Jun 01 09:34:00 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11" returned: 0 in 0.624s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Lock "cinder-quobyte-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11" released by "delete_volume" :: held 1.532s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Created reservations ['540770fe-8e83-42c6-9ff2-57f6e967621b', '876547e0-8fa7-495d-b385-70eb93960112', '2833ed51-b288-48d3-ae75-d07754112bdb', '0371ca06-3643-4c28-8809-2cc2ba55d0d8'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:00 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:34:00 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:01 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.637s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:01 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:34:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Deleted volume successfully. Jun 01 09:34:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e1041a8-4111-49b8-bc6e-22350d63139f tempest-VolumesTransfersV355Test-1555037281 None] Lock "cinder-a729fff1-6ea1-4c37-b7f5-3e6d2ed3be11-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:34:01 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:34:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Flow 'volume_create_manager' (fa606ec9-793c-4432-bb22-781306f7b413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:34:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545cb5d5-7e67-4a94-b84b-1ebe4ad2def2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545cb5d5-7e67-4a94-b84b-1ebe4ad2def2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1983521022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3037e18e-b7ad-4a53-8a95-6d9008acff8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dcb9eda40fb424ebcaba30f0adfab27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:34:02Z,use_quota=True,user_id='082d98386e48494298b75b27f8f0cd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52cf607-aae9-4626-9a9c-f1206730b10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52cf607-aae9-4626-9a9c-f1206730b10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbaeb2c-35a3-46b4-b95a-630bc0a15797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:01 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 01 09:34:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbaeb2c-35a3-46b4-b95a-630bc0a15797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3037e18e-b7ad-4a53-8a95-6d9008acff8a', 'volume_name': 'volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a', 'volume_size': 1, 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e7cfcad8294f4eb88f2de87e0a453e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'created_at': datetime.datetime(2026, 6, 1, 7, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac15924-d328-461c-8742-b7e32decb3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac15924-d328-461c-8742-b7e32decb3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2220a00e-8c9a-4bbe-b420-4420db6a93ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:02 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Volume 3037e18e-b7ad-4a53-8a95-6d9008acff8a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a', 'volume_size': 1, 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e7cfcad8294f4eb88f2de87e0a453e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'created_at': datetime.datetime(2026, 6, 1, 7, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 01 09:34:02 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Trying to clone 3037e18e-b7ad-4a53-8a95-6d9008acff8a from image c04f6c24-cff4-40fb-8629-0b2dcb859f85 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 01 09:34:02 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_08rlhfo5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 01 09:34:02 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Image download 20.69 MB at 20.69 MB/s Jun 01 09:34:02 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f5237f-1564-49ae-a765-2a8cfd329c1c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:34:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_08rlhfo5devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:02 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_08rlhfo5devstack@QuobyteHD Jun 01 09:34:02 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:03 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_08rlhfo5devstack@QuobyteHD" returned: 0 in 0.798s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:03 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Temporary image c04f6c24-cff4-40fb-8629-0b2dcb859f85 is fetched for user 082d98386e48494298b75b27f8f0cd88. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 01 09:34:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65264af-f819-49e6-8331-08ce80b93559]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:34:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_08rlhfo5devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:03 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_08rlhfo5devstack@QuobyteHD Jun 01 09:34:03 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-28d4ad5e-d5c8-4a56-898c-af0f354d2e2d req-da233dc6-8110-4275-8412-58c2d44bed60 tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-28d4ad5e-d5c8-4a56-898c-af0f354d2e2d req-da233dc6-8110-4275-8412-58c2d44bed60 tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4a871a-0ea6-4409-b431-b582dba40cb7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-28d4ad5e-d5c8-4a56-898c-af0f354d2e2d req-da233dc6-8110-4275-8412-58c2d44bed60 tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:04 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4 Jun 01 09:34:04 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:04 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_08rlhfo5devstack@QuobyteHD" returned: 0 in 0.923s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:04 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-28d4ad5e-d5c8-4a56-898c-af0f354d2e2d req-da233dc6-8110-4275-8412-58c2d44bed60 tempest-AttachVolumeTestJSON-1055284462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4" returned: 0 in 0.899s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-28d4ad5e-d5c8-4a56-898c-af0f354d2e2d req-da233dc6-8110-4275-8412-58c2d44bed60 tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.925s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.229s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1983521022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3037e18e-b7ad-4a53-8a95-6d9008acff8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dcb9eda40fb424ebcaba30f0adfab27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:34:02Z,use_quota=True,user_id='082d98386e48494298b75b27f8f0cd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Creating volume 3037e18e-b7ad-4a53-8a95-6d9008acff8a {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:34:04 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:04 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a 1073741824 Jun 01 09:34:04 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-28d4ad5e-d5c8-4a56-898c-af0f354d2e2d req-da233dc6-8110-4275-8412-58c2d44bed60 tempest-AttachVolumeTestJSON-1055284462 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-afaa2423-4c35-4ace-bd20-6b05b27485d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a408858-7c1f-4148-ba17-c2d882142034', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:34:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-28d4ad5e-d5c8-4a56-898c-af0f354d2e2d req-da233dc6-8110-4275-8412-58c2d44bed60 tempest-AttachVolumeTestJSON-1055284462 None] attachment_update completed successfully. Jun 01 09:34:05 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a 1073741824" returned: 0 in 0.837s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:05 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a Jun 01 09:34:05 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:06 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a" returned: 0 in 0.678s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:34:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Attempting download of c04f6c24-cff4-40fb-8629-0b2dcb859f85 ((None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}])) to volume 3037e18e-b7ad-4a53-8a95-6d9008acff8a. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 01 09:34:06 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ee7d24-7f87-4e5c-9568-c957a64048f7]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:34:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_h2853cjx {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:06 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_h2853cjx Jun 01 09:34:06 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:07 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_h2853cjx" returned: 0 in 0.719s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_h2853cjx {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:07 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_h2853cjx Jun 01 09:34:07 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:07 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_h2853cjx" returned: 1 in 0.733s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_h2853cjx' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:34:07 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0533e0-17ba-4260-a14e-843cbafe92b1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:34:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_08rlhfo5devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:08 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_08rlhfo5devstack@QuobyteHD Jun 01 09:34:08 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:08 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-8685b0a6-0945-42f5-8cce-a357205f0a8c req-c9d89433-f490-4872-a7e0-aee0fc9f9825 tempest-AttachVolumeShelveTestJSON-959099849 None] Terminate volume connection completed successfully. Jun 01 09:34:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-8685b0a6-0945-42f5-8cce-a357205f0a8c req-c9d89433-f490-4872-a7e0-aee0fc9f9825 tempest-AttachVolumeShelveTestJSON-959099849 None] Deleting attachment 9b69ae0a-a4e1-4a49-b323-ab25740e19db. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:34:08 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_08rlhfo5devstack@QuobyteHD" returned: 0 in 0.766s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:08 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] c04f6c24-cff4-40fb-8629-0b2dcb859f85 was qcow2, converting to raw {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 01 09:34:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_08rlhfo5devstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:08 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_08rlhfo5devstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a Jun 01 09:34:08 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Flow 'volume_create_manager' (8c1df018-c5d2-49b5-a914-1f250dd9e13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4518e22-70fe-4d65-b7c9-c13730461c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4518e22-70fe-4d65-b7c9-c13730461c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1611764054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e593ff6c-ee97-441c-888c-c4c9975759f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae848e9102940c092d4e8bbced46e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:34:10Z,use_quota=True,user_id='1271b039186f46efb79203f5db531851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01aae139-4917-4b42-a81f-1e0111a624a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01aae139-4917-4b42-a81f-1e0111a624a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6998a19d-405f-4fa5-945b-970b437c7cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6998a19d-405f-4fa5-945b-970b437c7cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e593ff6c-ee97-441c-888c-c4c9975759f8', 'volume_name': 'volume-e593ff6c-ee97-441c-888c-c4c9975759f8', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168a0800-62a1-4e93-b17b-a7c8db180f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168a0800-62a1-4e93-b17b-a7c8db180f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62799319-db10-4f5b-b747-2459c185ec7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:10 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Volume e593ff6c-ee97-441c-888c-c4c9975759f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e593ff6c-ee97-441c-888c-c4c9975759f8', 'volume_size': 1} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1611764054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e593ff6c-ee97-441c-888c-c4c9975759f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae848e9102940c092d4e8bbced46e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:34:10Z,use_quota=True,user_id='1271b039186f46efb79203f5db531851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Creating volume e593ff6c-ee97-441c-888c-c4c9975759f8 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:34:10 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:34:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:10 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8 1073741824 Jun 01 09:34:10 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:11 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_08rlhfo5devstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a" returned: 0 in 2.332s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:11 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_08rlhfo5devstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:34:11 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Converted 112.00 MB image at 48.00 MB/s Jun 01 09:34:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:11 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a 1G Jun 01 09:34:11 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:11 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8 1073741824" returned: 0 in 0.972s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:11 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8 Jun 01 09:34:11 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:11 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a 1G" returned: 0 in 0.686s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:11 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c47d22-c922-4181-9ca3-ca3afde17daa]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:34:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:12 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a Jun 01 09:34:12 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:12 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8" returned: 0 in 0.847s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:34:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62799319-db10-4f5b-b747-2459c185ec7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e593ff6c-ee97-441c-888c-c4c9975759f8', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf05c48-1933-48e8-a040-faf81f34c643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:12 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Volume volume-e593ff6c-ee97-441c-888c-c4c9975759f8 (e593ff6c-ee97-441c-888c-c4c9975759f8): created successfully Jun 01 09:34:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf05c48-1933-48e8-a040-faf81f34c643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Flow 'volume_create_manager' (8c1df018-c5d2-49b5-a914-1f250dd9e13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:34:12 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6625f605-5c09-4e52-af98-690e068a280f tempest-AttachVolumeTestJSON-1055284462 None] Created volume successfully. Jun 01 09:34:13 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a" returned: 0 in 1.181s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:13 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a Jun 01 09:34:13 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:13 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a" returned: 1 in 0.839s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:34:13 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Downloaded image c04f6c24-cff4-40fb-8629-0b2dcb859f85 ((None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}])) to volume 3037e18e-b7ad-4a53-8a95-6d9008acff8a successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 01 09:34:13 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Temporary image c04f6c24-cff4-40fb-8629-0b2dcb859f85 for user 082d98386e48494298b75b27f8f0cd88 is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 01 09:34:13 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Marking volume 3037e18e-b7ad-4a53-8a95-6d9008acff8a as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 01 09:34:13 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Copying metadata from image c04f6c24-cff4-40fb-8629-0b2dcb859f85 to 3037e18e-b7ad-4a53-8a95-6d9008acff8a. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 01 09:34:13 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Creating volume glance metadata for volume 3037e18e-b7ad-4a53-8a95-6d9008acff8a backed by image c04f6c24-cff4-40fb-8629-0b2dcb859f85 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 01 09:34:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2220a00e-8c9a-4bbe-b420-4420db6a93ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a', 'volume_size': 1, 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e7cfcad8294f4eb88f2de87e0a453e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'created_at': datetime.datetime(2026, 6, 1, 7, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f970a81-f599-4982-8ea9-5f693590d413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:14 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Volume volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a (3037e18e-b7ad-4a53-8a95-6d9008acff8a): created successfully Jun 01 09:34:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f970a81-f599-4982-8ea9-5f693590d413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Flow 'volume_create_manager' (fa606ec9-793c-4432-bb22-781306f7b413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:34:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4b9879d5-d368-4641-b493-d04604030015 tempest-TestShelveInstance-1144217599 None] Created volume successfully. Jun 01 09:34:16 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:34:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Flow 'volume_create_manager' (37641d16-4156-4704-aaf8-e0911f11e661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:34:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866f4f78-4be8-46c0-8525-011f5db6e77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866f4f78-4be8-46c0-8525-011f5db6e77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1487654558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593b69be-e600-4c48-9072-1603b075201b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bca5c63decf41a488b1b9433291c3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:34:17Z,use_quota=True,user_id='a20e092fd3154f54b3860425032dc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284f1819-2b86-41c3-be31-00838d16b891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284f1819-2b86-41c3-be31-00838d16b891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ed4685-f6b3-4df9-8dca-cb8d2ca22427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ed4685-f6b3-4df9-8dca-cb8d2ca22427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '593b69be-e600-4c48-9072-1603b075201b', 'volume_name': 'volume-593b69be-e600-4c48-9072-1603b075201b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6def88ef-c670-4824-8711-3171cadda6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6def88ef-c670-4824-8711-3171cadda6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c10b15-ff27-47d9-891e-9519b6a01887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:17 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Volume 593b69be-e600-4c48-9072-1603b075201b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-593b69be-e600-4c48-9072-1603b075201b', 'volume_size': 1} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1487654558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593b69be-e600-4c48-9072-1603b075201b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bca5c63decf41a488b1b9433291c3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:34:17Z,use_quota=True,user_id='a20e092fd3154f54b3860425032dc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Creating volume 593b69be-e600-4c48-9072-1603b075201b {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:34:17 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-a1f46145-2c48-4ddb-afb0-6a7b9a5d5158 req-fa29fa8f-ff0d-4e40-98de-da3aa735341c tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:17 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b 1073741824 Jun 01 09:34:17 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:18 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b 1073741824" returned: 0 in 1.115s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:18 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b Jun 01 09:34:18 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:18 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b" returned: 0 in 0.618s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:34:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-a1f46145-2c48-4ddb-afb0-6a7b9a5d5158 req-fa29fa8f-ff0d-4e40-98de-da3aa735341c tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.757s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c10b15-ff27-47d9-891e-9519b6a01887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-593b69be-e600-4c48-9072-1603b075201b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f5da716-73c7-4cd3-8597-7739b9a5c16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:34:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a32d45-c115-4054-96db-a64d96afd534]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:34:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-a1f46145-2c48-4ddb-afb0-6a7b9a5d5158 req-fa29fa8f-ff0d-4e40-98de-da3aa735341c tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:18 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Volume volume-593b69be-e600-4c48-9072-1603b075201b (593b69be-e600-4c48-9072-1603b075201b): created successfully Jun 01 09:34:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f5da716-73c7-4cd3-8597-7739b9a5c16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:34:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Flow 'volume_create_manager' (37641d16-4156-4704-aaf8-e0911f11e661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:34:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c3ba857e-7f2d-47cc-8ad5-ee9b127f8787 tempest-VolumesActionsTest-603787341 None] Created volume successfully. Jun 01 09:34:19 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8 Jun 01 09:34:19 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:19 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-a1f46145-2c48-4ddb-afb0-6a7b9a5d5158 req-fa29fa8f-ff0d-4e40-98de-da3aa735341c tempest-AttachVolumeTestJSON-1055284462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8" returned: 0 in 0.816s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-a1f46145-2c48-4ddb-afb0-6a7b9a5d5158 req-fa29fa8f-ff0d-4e40-98de-da3aa735341c tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.863s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-a1f46145-2c48-4ddb-afb0-6a7b9a5d5158 req-fa29fa8f-ff0d-4e40-98de-da3aa735341c tempest-AttachVolumeTestJSON-1055284462 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-e593ff6c-ee97-441c-888c-c4c9975759f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff0b64fb-6525-460a-bc61-8e1e11454aef', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:34:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-a1f46145-2c48-4ddb-afb0-6a7b9a5d5158 req-fa29fa8f-ff0d-4e40-98de-da3aa735341c tempest-AttachVolumeTestJSON-1055284462 None] attachment_update completed successfully. Jun 01 09:34:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-26f2b89b-2445-4439-a50f-1f3980c6aa73 req-2e7270d6-315c-4fc9-93bd-37aea5f6e948 tempest-TestShelveInstance-1144217599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-26f2b89b-2445-4439-a50f-1f3980c6aa73 req-2e7270d6-315c-4fc9-93bd-37aea5f6e948 tempest-TestShelveInstance-1144217599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:23 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ba95df-e0af-4762-9855-aa918749b2fe]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:34:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-26f2b89b-2445-4439-a50f-1f3980c6aa73 req-2e7270d6-315c-4fc9-93bd-37aea5f6e948 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:23 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a Jun 01 09:34:23 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:24 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-26f2b89b-2445-4439-a50f-1f3980c6aa73 req-2e7270d6-315c-4fc9-93bd-37aea5f6e948 tempest-TestShelveInstance-1144217599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a" returned: 0 in 1.020s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-26f2b89b-2445-4439-a50f-1f3980c6aa73 req-2e7270d6-315c-4fc9-93bd-37aea5f6e948 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:24 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a Jun 01 09:34:24 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:25 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-26f2b89b-2445-4439-a50f-1f3980c6aa73 req-2e7270d6-315c-4fc9-93bd-37aea5f6e948 tempest-TestShelveInstance-1144217599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a" returned: 1 in 0.762s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-26f2b89b-2445-4439-a50f-1f3980c6aa73 req-2e7270d6-315c-4fc9-93bd-37aea5f6e948 tempest-TestShelveInstance-1144217599 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:34:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-26f2b89b-2445-4439-a50f-1f3980c6aa73 req-2e7270d6-315c-4fc9-93bd-37aea5f6e948 tempest-TestShelveInstance-1144217599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.864s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-26f2b89b-2445-4439-a50f-1f3980c6aa73 req-2e7270d6-315c-4fc9-93bd-37aea5f6e948 tempest-TestShelveInstance-1144217599 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78506a7a-c37d-45a6-b67a-1087b3c54a7b', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:34:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-26f2b89b-2445-4439-a50f-1f3980c6aa73 req-2e7270d6-315c-4fc9-93bd-37aea5f6e948 tempest-TestShelveInstance-1144217599 None] attachment_update completed successfully. Jun 01 09:34:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-c08bf45f-6040-417c-9a42-aa0b300afc06 req-9c9c1d6b-64a1-4463-bc20-31f2d7cdb2f1 tempest-AttachVolumeTestJSON-1055284462 None] Terminate volume connection completed successfully. Jun 01 09:34:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-c08bf45f-6040-417c-9a42-aa0b300afc06 req-9c9c1d6b-64a1-4463-bc20-31f2d7cdb2f1 tempest-AttachVolumeTestJSON-1055284462 None] Deleting attachment 8a408858-7c1f-4148-ba17-c2d882142034. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:34:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-e20daedd-d3b9-4270-89a5-e01912d1f9b7 req-41db4746-8f7c-44f2-b93c-4caadffd6f29 tempest-AttachVolumeTestJSON-1055284462 None] Terminate volume connection completed successfully. Jun 01 09:34:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e20daedd-d3b9-4270-89a5-e01912d1f9b7 req-41db4746-8f7c-44f2-b93c-4caadffd6f29 tempest-AttachVolumeTestJSON-1055284462 None] Deleting attachment ff0b64fb-6525-460a-bc61-8e1e11454aef. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:34:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-26f2b89b-2445-4439-a50f-1f3980c6aa73 req-151c9b9f-a2cc-4855-ac0b-ac51406bb098 tempest-TestShelveInstance-1144217599 None] Terminate volume connection completed successfully. Jun 01 09:34:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-26f2b89b-2445-4439-a50f-1f3980c6aa73 req-151c9b9f-a2cc-4855-ac0b-ac51406bb098 tempest-TestShelveInstance-1144217599 None] Deleting attachment 78506a7a-c37d-45a6-b67a-1087b3c54a7b. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:34:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:34:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:34:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:34:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-978eb90c-92d8-4d8a-bae8-cf0e684ab511 tempest-VolumesActionsTest-603787341 None] Acquiring lock "cinder-593b69be-e600-4c48-9072-1603b075201b" by "attach_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:34:36 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:34:36 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-978eb90c-92d8-4d8a-bae8-cf0e684ab511 tempest-VolumesActionsTest-603787341 None] Lock "cinder-593b69be-e600-4c48-9072-1603b075201b" acquired by "attach_volume" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:34:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-978eb90c-92d8-4d8a-bae8-cf0e684ab511 tempest-VolumesActionsTest-603787341 None] Attaching volume 593b69be-e600-4c48-9072-1603b075201b to instance f5a41c0b-453e-4b9b-ba72-dfe1a36384cc at mountpoint /dev/vdb on host None. Jun 01 09:34:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-978eb90c-92d8-4d8a-bae8-cf0e684ab511 tempest-VolumesActionsTest-603787341 None] Attach volume completed successfully. Jun 01 09:34:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-978eb90c-92d8-4d8a-bae8-cf0e684ab511 tempest-VolumesActionsTest-603787341 None] Lock "cinder-593b69be-e600-4c48-9072-1603b075201b" released by "attach_volume" :: held 0.118s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:34:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-703b8798-eb7c-4cdb-827d-75fa689d562f tempest-VolumesActionsTest-603787341 None] Acquiring lock "cinder-593b69be-e600-4c48-9072-1603b075201b-detach_volume" by "detach_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:34:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-703b8798-eb7c-4cdb-827d-75fa689d562f tempest-VolumesActionsTest-603787341 None] Lock "cinder-593b69be-e600-4c48-9072-1603b075201b-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:34:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-703b8798-eb7c-4cdb-827d-75fa689d562f tempest-VolumesActionsTest-603787341 None] Detaching volume 593b69be-e600-4c48-9072-1603b075201b from instance f5a41c0b-453e-4b9b-ba72-dfe1a36384cc. Jun 01 09:34:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-703b8798-eb7c-4cdb-827d-75fa689d562f tempest-VolumesActionsTest-603787341 None] Detach volume completed successfully. Jun 01 09:34:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-703b8798-eb7c-4cdb-827d-75fa689d562f tempest-VolumesActionsTest-603787341 None] Lock "cinder-593b69be-e600-4c48-9072-1603b075201b-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:34:37 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.024s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:34:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Acquiring lock "cinder-3037e18e-b7ad-4a53-8a95-6d9008acff8a-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:34:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Lock "cinder-3037e18e-b7ad-4a53-8a95-6d9008acff8a-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:34:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Acquiring lock "cinder-quobyte-3037e18e-b7ad-4a53-8a95-6d9008acff8a" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:34:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Lock "cinder-quobyte-3037e18e-b7ad-4a53-8a95-6d9008acff8a" acquired by "delete_volume" :: waited 0.052s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:34:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca51d352-64c2-480d-ba9a-30f04bd31df9]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:34:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:39 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a Jun 01 09:34:39 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:40 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a" returned: 0 in 0.962s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:40 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a Jun 01 09:34:40 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "cinder-e593ff6c-ee97-441c-888c-c4c9975759f8-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:34:41 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a" returned: 1 in 1.220s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:34:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Lock "cinder-e593ff6c-ee97-441c-888c-c4c9975759f8-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:34:41 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a Jun 01 09:34:41 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:41 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=58,cinder:UPDATE=46,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:34:41 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=43,cinder:SELECT=60,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:34:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "cinder-quobyte-e593ff6c-ee97-441c-888c-c4c9975759f8" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:34:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Lock "cinder-quobyte-e593ff6c-ee97-441c-888c-c4c9975759f8" acquired by "delete_volume" :: waited 0.042s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:34:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8296ec4e-ebfd-4499-af5a-e0a9c4cda321]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:34:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:42 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8 Jun 01 09:34:42 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:42 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3037e18e-b7ad-4a53-8a95-6d9008acff8a" returned: 0 in 1.258s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Lock "cinder-quobyte-3037e18e-b7ad-4a53-8a95-6d9008acff8a" released by "delete_volume" :: held 3.571s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:34:43 devstack cinder-volume[86649]: DEBUG cinder.quota [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Created reservations ['49a48a45-34fa-4842-ac97-fc86b070fbf9', 'fcc65760-05f7-40f7-8f1d-e7ccf16bd52e', '2e218c08-9d31-4f2f-9a16-f5d8b697cb9c', '1eb8d49f-96cd-4950-b857-887345f09a13'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:34:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:34:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:34:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:43 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:34:43 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:43 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8" returned: 0 in 1.199s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:43 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8 Jun 01 09:34:43 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:43 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.817s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:43 devstack cinder-volume[86649]: DEBUG cinder.manager [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:34:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Deleted volume successfully. Jun 01 09:34:43 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e593ff6c-ee97-441c-888c-c4c9975759f8" returned: 0 in 0.795s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-98eebc2d-b0bd-4787-a7f4-2a98fadd3be5 req-9f720b98-dfdc-489b-a1dc-ddc237b5ebb1 tempest-TestShelveInstance-1144217599 None] Lock "cinder-3037e18e-b7ad-4a53-8a95-6d9008acff8a-delete_volume" released by "delete_volume" :: held 4.777s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:34:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Lock "cinder-quobyte-e593ff6c-ee97-441c-888c-c4c9975759f8" released by "delete_volume" :: held 2.076s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:34:44 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Created reservations ['3b436bb0-79ab-48ae-b69c-98b355aeb48a', 'ab086ba6-9bf8-479d-baf6-669e92c52bd2', '505294c1-e9f5-4551-ba52-6ee603a79990', 'c8edbbcc-2708-4123-9474-85edc3547305'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:34:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:34:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:34:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:44 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:34:44 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:45 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.807s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:45 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:34:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Deleted volume successfully. Jun 01 09:34:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8a8070a4-a4ff-4f61-a872-d17433ef393b tempest-AttachVolumeTestJSON-1055284462 None] Lock "cinder-e593ff6c-ee97-441c-888c-c4c9975759f8-delete_volume" released by "delete_volume" :: held 3.350s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:34:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "cinder-afaa2423-4c35-4ace-bd20-6b05b27485d4-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:34:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Lock "cinder-afaa2423-4c35-4ace-bd20-6b05b27485d4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:34:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "cinder-quobyte-afaa2423-4c35-4ace-bd20-6b05b27485d4" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:34:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Lock "cinder-quobyte-afaa2423-4c35-4ace-bd20-6b05b27485d4" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:34:45 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[805d7a19-6aad-4cf6-bd4c-db412ed769c5]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:34:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:45 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4 Jun 01 09:34:45 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:46 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4" returned: 0 in 1.136s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:46 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4 Jun 01 09:34:46 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:47 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-afaa2423-4c35-4ace-bd20-6b05b27485d4" returned: 0 in 1.033s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Lock "cinder-quobyte-afaa2423-4c35-4ace-bd20-6b05b27485d4" released by "delete_volume" :: held 2.251s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:34:47 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Created reservations ['e71b52ed-3250-41e4-bbd3-51357bebf58d', 'bbbbb8cf-4b4d-4cf5-bcf1-62f1dbb9ad2f', 'e06502fb-4451-4a88-971b-849534c21c10', 'ff8dec5f-1bc9-4821-ae1a-7d93056da058'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:34:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:34:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:34:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:47 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:34:47 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:48 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.841s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:48 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:34:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Deleted volume successfully. Jun 01 09:34:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a82265f2-c73f-4963-8799-28d8ab350ce6 tempest-AttachVolumeTestJSON-1055284462 None] Lock "cinder-afaa2423-4c35-4ace-bd20-6b05b27485d4-delete_volume" released by "delete_volume" :: held 3.433s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:34:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "cinder-5937f78f-ffd1-4c7b-aeaf-794751de6536-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:34:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Lock "cinder-5937f78f-ffd1-4c7b-aeaf-794751de6536-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:34:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "cinder-quobyte-5937f78f-ffd1-4c7b-aeaf-794751de6536" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:34:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Lock "cinder-quobyte-5937f78f-ffd1-4c7b-aeaf-794751de6536" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:34:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc94ff6-218f-45fd-9dc7-8694e56a0f7c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:34:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:49 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536 Jun 01 09:34:49 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:50 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536" returned: 0 in 1.094s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:50 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536 Jun 01 09:34:50 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:50 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5937f78f-ffd1-4c7b-aeaf-794751de6536" returned: 0 in 0.704s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Lock "cinder-quobyte-5937f78f-ffd1-4c7b-aeaf-794751de6536" released by "delete_volume" :: held 1.841s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:34:50 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Created reservations ['f1fe91a0-eccb-4c14-8edd-13a91aa617f7', '07221866-86f4-4618-99ce-577c378cf4cc', '92092cfa-2823-4d61-8263-d777b4c068b7', '187a518c-92a9-4e2c-8b26-60af472bb9a3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:34:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:34:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:34:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:34:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:34:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:34:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:34:50 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:34:50 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:34:51 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Jun 01 09:34:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.793s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:34:51 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:34:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Deleted volume successfully. Jun 01 09:34:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a9d271a-786f-4c7b-bfcc-95f5f45b335d tempest-AttachVolumeTestJSON-1055284462 None] Lock "cinder-5937f78f-ffd1-4c7b-aeaf-794751de6536-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Flow 'volume_create_manager' (dd99ebc8-223b-4dc8-86cf-5ad8da6af592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76e9cb0-74ef-4140-959e-47091f79280a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76e9cb0-74ef-4140-959e-47091f79280a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1095766675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f63e9f-4f00-43f6-9199-89a0326b228a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f53d4318ebf04e84ae41c789a38bb135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:35:00Z,use_quota=True,user_id='b57ade4fffe9419f8a228a02c6de8bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b8fd50-ecef-44f1-ab0d-c711716d9765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b8fd50-ecef-44f1-ab0d-c711716d9765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27d5e73-e2a6-41ca-9f0c-e9462d17caa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27d5e73-e2a6-41ca-9f0c-e9462d17caa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99f63e9f-4f00-43f6-9199-89a0326b228a', 'volume_name': 'volume-99f63e9f-4f00-43f6-9199-89a0326b228a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd984a39-3018-4bce-aa27-c23b8e663107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd984a39-3018-4bce-aa27-c23b8e663107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d52494-4530-4ec6-9d12-41a82d1bcd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:00 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Volume 99f63e9f-4f00-43f6-9199-89a0326b228a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99f63e9f-4f00-43f6-9199-89a0326b228a', 'volume_size': 1} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1095766675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f63e9f-4f00-43f6-9199-89a0326b228a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f53d4318ebf04e84ae41c789a38bb135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:35:00Z,use_quota=True,user_id='b57ade4fffe9419f8a228a02c6de8bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Creating volume 99f63e9f-4f00-43f6-9199-89a0326b228a {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:35:00 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:35:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-99f63e9f-4f00-43f6-9199-89a0326b228a 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:00 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-99f63e9f-4f00-43f6-9199-89a0326b228a 1073741824 Jun 01 09:35:00 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:01 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-99f63e9f-4f00-43f6-9199-89a0326b228a 1073741824" returned: 0 in 0.986s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-99f63e9f-4f00-43f6-9199-89a0326b228a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:01 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-99f63e9f-4f00-43f6-9199-89a0326b228a Jun 01 09:35:01 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:02 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-99f63e9f-4f00-43f6-9199-89a0326b228a" returned: 0 in 0.616s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:35:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d52494-4530-4ec6-9d12-41a82d1bcd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99f63e9f-4f00-43f6-9199-89a0326b228a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4dbc8a-1975-4889-863f-0a5c2a75f132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:02 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Volume volume-99f63e9f-4f00-43f6-9199-89a0326b228a (99f63e9f-4f00-43f6-9199-89a0326b228a): created successfully Jun 01 09:35:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4dbc8a-1975-4889-863f-0a5c2a75f132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Flow 'volume_create_manager' (dd99ebc8-223b-4dc8-86cf-5ad8da6af592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:35:02 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-96792a5e-f607-41c4-ad78-c06b97f6e95c tempest-VolumesTestJSON-898103957 None] Created volume successfully. Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Flow 'volume_create_manager' (45c6c6fd-d9c9-4a2e-a27c-624e837ba382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229bd73c-276a-4b99-b5c1-2a6110a9d6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229bd73c-276a-4b99-b5c1-2a6110a9d6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1518790844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22672d5d-e694-4107-babe-f92076e1b7a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f53d4318ebf04e84ae41c789a38bb135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:35:03Z,use_quota=True,user_id='b57ade4fffe9419f8a228a02c6de8bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08398fc-e1b5-48bb-8bf9-80db71a693d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08398fc-e1b5-48bb-8bf9-80db71a693d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eafd6af-1de2-4159-a09f-2168dc0106cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eafd6af-1de2-4159-a09f-2168dc0106cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22672d5d-e694-4107-babe-f92076e1b7a6', 'volume_name': 'volume-22672d5d-e694-4107-babe-f92076e1b7a6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d2a5b2-3431-436d-a4e0-664b56504871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d2a5b2-3431-436d-a4e0-664b56504871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50aa545f-9bc7-4d2d-b8aa-5acbdc8e2870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:03 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Volume 22672d5d-e694-4107-babe-f92076e1b7a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22672d5d-e694-4107-babe-f92076e1b7a6', 'volume_size': 1} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1518790844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22672d5d-e694-4107-babe-f92076e1b7a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f53d4318ebf04e84ae41c789a38bb135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:35:03Z,use_quota=True,user_id='b57ade4fffe9419f8a228a02c6de8bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Creating volume 22672d5d-e694-4107-babe-f92076e1b7a6 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:35:03 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-22672d5d-e694-4107-babe-f92076e1b7a6 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:03 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-22672d5d-e694-4107-babe-f92076e1b7a6 1073741824 Jun 01 09:35:03 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5626b5c9-7271-42e7-8702-9454f38d30a6 tempest-VolumesActionsTest-603787341 None] Acquiring lock "cinder-593b69be-e600-4c48-9072-1603b075201b" by "attach_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5626b5c9-7271-42e7-8702-9454f38d30a6 tempest-VolumesActionsTest-603787341 None] Lock "cinder-593b69be-e600-4c48-9072-1603b075201b" acquired by "attach_volume" :: waited 0.032s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:35:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5626b5c9-7271-42e7-8702-9454f38d30a6 tempest-VolumesActionsTest-603787341 None] Attaching volume 593b69be-e600-4c48-9072-1603b075201b to instance 71ec52cf-7d67-463b-ac01-0501e2970dc2 at mountpoint /dev/vdb on host None. Jun 01 09:35:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5626b5c9-7271-42e7-8702-9454f38d30a6 tempest-VolumesActionsTest-603787341 None] Attach volume completed successfully. Jun 01 09:35:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5626b5c9-7271-42e7-8702-9454f38d30a6 tempest-VolumesActionsTest-603787341 None] Lock "cinder-593b69be-e600-4c48-9072-1603b075201b" released by "attach_volume" :: held 0.134s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:35:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-be36889d-1fde-4449-a106-cbb3876d421f tempest-VolumesActionsTest-603787341 None] Acquiring lock "cinder-593b69be-e600-4c48-9072-1603b075201b-detach_volume" by "detach_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:35:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-be36889d-1fde-4449-a106-cbb3876d421f tempest-VolumesActionsTest-603787341 None] Lock "cinder-593b69be-e600-4c48-9072-1603b075201b-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:35:04 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-be36889d-1fde-4449-a106-cbb3876d421f tempest-VolumesActionsTest-603787341 None] Detaching volume 593b69be-e600-4c48-9072-1603b075201b from instance 71ec52cf-7d67-463b-ac01-0501e2970dc2. Jun 01 09:35:04 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-22672d5d-e694-4107-babe-f92076e1b7a6 1073741824" returned: 0 in 1.011s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:04 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-be36889d-1fde-4449-a106-cbb3876d421f tempest-VolumesActionsTest-603787341 None] Detach volume completed successfully. Jun 01 09:35:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-be36889d-1fde-4449-a106-cbb3876d421f tempest-VolumesActionsTest-603787341 None] Lock "cinder-593b69be-e600-4c48-9072-1603b075201b-detach_volume" released by "detach_volume" :: held 0.069s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:35:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-22672d5d-e694-4107-babe-f92076e1b7a6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:04 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-22672d5d-e694-4107-babe-f92076e1b7a6 Jun 01 09:35:04 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:04 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-22672d5d-e694-4107-babe-f92076e1b7a6" returned: 0 in 0.640s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:35:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50aa545f-9bc7-4d2d-b8aa-5acbdc8e2870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22672d5d-e694-4107-babe-f92076e1b7a6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca91f8f7-2186-4852-98e5-db66adae3136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:05 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Volume volume-22672d5d-e694-4107-babe-f92076e1b7a6 (22672d5d-e694-4107-babe-f92076e1b7a6): created successfully Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca91f8f7-2186-4852-98e5-db66adae3136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Flow 'volume_create_manager' (45c6c6fd-d9c9-4a2e-a27c-624e837ba382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:35:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3c0911af-001a-4bc6-8918-66ec219046f8 tempest-VolumesTestJSON-898103957 None] Created volume successfully. Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Flow 'volume_create_manager' (86bcf439-06c1-48a6-b8b7-bdef7ae4dddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2907d3-50d3-48e6-941a-c8b78f220faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2907d3-50d3-48e6-941a-c8b78f220faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-798695029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48fe51d-52db-4747-819e-fc7446ee9374,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f53d4318ebf04e84ae41c789a38bb135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:35:06Z,use_quota=True,user_id='b57ade4fffe9419f8a228a02c6de8bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e0904e-758a-49d5-bdda-e228edb84c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e0904e-758a-49d5-bdda-e228edb84c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f099523-69d0-485f-949c-6d8cb8265882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f099523-69d0-485f-949c-6d8cb8265882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b48fe51d-52db-4747-819e-fc7446ee9374', 'volume_name': 'volume-b48fe51d-52db-4747-819e-fc7446ee9374', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571d245d-0091-4950-a03a-50611b30328e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571d245d-0091-4950-a03a-50611b30328e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793eecde-c68a-4a85-b0c4-cbf8047594c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:05 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Volume b48fe51d-52db-4747-819e-fc7446ee9374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b48fe51d-52db-4747-819e-fc7446ee9374', 'volume_size': 1} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-798695029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48fe51d-52db-4747-819e-fc7446ee9374,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f53d4318ebf04e84ae41c789a38bb135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:35:06Z,use_quota=True,user_id='b57ade4fffe9419f8a228a02c6de8bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Creating volume b48fe51d-52db-4747-819e-fc7446ee9374 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:35:05 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:35:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b48fe51d-52db-4747-819e-fc7446ee9374 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:05 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b48fe51d-52db-4747-819e-fc7446ee9374 1073741824 Jun 01 09:35:05 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:06 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b48fe51d-52db-4747-819e-fc7446ee9374 1073741824" returned: 0 in 0.969s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b48fe51d-52db-4747-819e-fc7446ee9374 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:06 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b48fe51d-52db-4747-819e-fc7446ee9374 Jun 01 09:35:06 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:07 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b48fe51d-52db-4747-819e-fc7446ee9374" returned: 0 in 0.572s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:35:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793eecde-c68a-4a85-b0c4-cbf8047594c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b48fe51d-52db-4747-819e-fc7446ee9374', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35ee2e3-1a2c-4836-928a-e3055394f8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:07 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Volume volume-b48fe51d-52db-4747-819e-fc7446ee9374 (b48fe51d-52db-4747-819e-fc7446ee9374): created successfully Jun 01 09:35:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35ee2e3-1a2c-4836-928a-e3055394f8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Flow 'volume_create_manager' (86bcf439-06c1-48a6-b8b7-bdef7ae4dddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:35:07 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4f8d0935-93b5-4868-ba82-5515fb06fc7a tempest-VolumesTestJSON-898103957 None] Created volume successfully. Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Flow 'volume_create_manager' (64891542-c533-4535-bb16-e22fa067a538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bba5a89-958e-4e75-84e3-1cd72b85fb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bba5a89-958e-4e75-84e3-1cd72b85fb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2118330108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551cff51-10f4-4e49-8ddf-ee04ed604c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a41cecfaca5458883c2ad6c2730235f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:35:08Z,use_quota=True,user_id='51e03ff572ca4be48d978386fa0d1cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8f60f3-8b23-434d-a63f-eb480970f69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8f60f3-8b23-434d-a63f-eb480970f69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2827ae4b-70bd-437c-a8f0-18852e9eb3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2827ae4b-70bd-437c-a8f0-18852e9eb3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '551cff51-10f4-4e49-8ddf-ee04ed604c06', 'volume_name': 'volume-551cff51-10f4-4e49-8ddf-ee04ed604c06', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93e32f8-7a26-436b-bbf3-1aeb0472aa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93e32f8-7a26-436b-bbf3-1aeb0472aa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f487f6-f475-4160-9084-39a9968b1793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:08 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Volume 551cff51-10f4-4e49-8ddf-ee04ed604c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-551cff51-10f4-4e49-8ddf-ee04ed604c06', 'volume_size': 1} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2118330108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551cff51-10f4-4e49-8ddf-ee04ed604c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a41cecfaca5458883c2ad6c2730235f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:35:08Z,use_quota=True,user_id='51e03ff572ca4be48d978386fa0d1cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Creating volume 551cff51-10f4-4e49-8ddf-ee04ed604c06 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:35:08 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-551cff51-10f4-4e49-8ddf-ee04ed604c06 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:08 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-551cff51-10f4-4e49-8ddf-ee04ed604c06 1073741824 Jun 01 09:35:08 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Acquiring lock "cinder-b48fe51d-52db-4747-819e-fc7446ee9374-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Lock "cinder-b48fe51d-52db-4747-819e-fc7446ee9374-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Acquiring lock "cinder-quobyte-b48fe51d-52db-4747-819e-fc7446ee9374" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Lock "cinder-quobyte-b48fe51d-52db-4747-819e-fc7446ee9374" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[245e4881-0bfe-4d1c-831a-55aaba7d93a6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:35:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b48fe51d-52db-4747-819e-fc7446ee9374 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:08 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b48fe51d-52db-4747-819e-fc7446ee9374 Jun 01 09:35:08 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:09 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-551cff51-10f4-4e49-8ddf-ee04ed604c06 1073741824" returned: 0 in 0.775s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-551cff51-10f4-4e49-8ddf-ee04ed604c06 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:09 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-551cff51-10f4-4e49-8ddf-ee04ed604c06 Jun 01 09:35:09 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:09 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b48fe51d-52db-4747-819e-fc7446ee9374" returned: 0 in 0.750s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b48fe51d-52db-4747-819e-fc7446ee9374 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:09 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b48fe51d-52db-4747-819e-fc7446ee9374 Jun 01 09:35:09 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:09 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-551cff51-10f4-4e49-8ddf-ee04ed604c06" returned: 0 in 0.635s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:35:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f487f6-f475-4160-9084-39a9968b1793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-551cff51-10f4-4e49-8ddf-ee04ed604c06', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8b342d-588c-4c4c-8ec1-72f0f8c8a94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:09 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Volume volume-551cff51-10f4-4e49-8ddf-ee04ed604c06 (551cff51-10f4-4e49-8ddf-ee04ed604c06): created successfully Jun 01 09:35:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8b342d-588c-4c4c-8ec1-72f0f8c8a94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Flow 'volume_create_manager' (64891542-c533-4535-bb16-e22fa067a538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:35:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ae1d82fc-890a-47d5-9cef-3fa1f07ba266 tempest-AttachVolumeShelveTestJSON-959099849 None] Created volume successfully. Jun 01 09:35:10 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b48fe51d-52db-4747-819e-fc7446ee9374" returned: 0 in 0.674s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Lock "cinder-quobyte-b48fe51d-52db-4747-819e-fc7446ee9374" released by "delete_volume" :: held 1.463s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Created reservations ['dac4da3a-bf42-41bb-95d6-8fa523ea4ec2', '6e82ae83-09be-4db3-aa81-f5bc9fab0358', 'c6d111d5-eb0c-4e1b-bd39-d7df1bba0133', 'ecb51fa6-d547-4fc0-a451-56334d7c0e2d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:10 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:35:10 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:10 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Acquiring lock "cinder-22672d5d-e694-4107-babe-f92076e1b7a6-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.605s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:35:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Deleted volume successfully. Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Lock "cinder-22672d5d-e694-4107-babe-f92076e1b7a6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-62a8cfca-59cc-4f6d-bdc5-07ed36f0e20d tempest-VolumesTestJSON-898103957 None] Lock "cinder-b48fe51d-52db-4747-819e-fc7446ee9374-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Acquiring lock "cinder-quobyte-22672d5d-e694-4107-babe-f92076e1b7a6" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:35:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Lock "cinder-quobyte-22672d5d-e694-4107-babe-f92076e1b7a6" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:35:11 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdaab0a-181c-42ce-975e-45ad7a142565]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:35:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-22672d5d-e694-4107-babe-f92076e1b7a6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:11 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-22672d5d-e694-4107-babe-f92076e1b7a6 Jun 01 09:35:11 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:11 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-22672d5d-e694-4107-babe-f92076e1b7a6" returned: 0 in 0.810s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-22672d5d-e694-4107-babe-f92076e1b7a6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:11 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-22672d5d-e694-4107-babe-f92076e1b7a6 Jun 01 09:35:11 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:12 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-22672d5d-e694-4107-babe-f92076e1b7a6" returned: 0 in 0.611s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Lock "cinder-quobyte-22672d5d-e694-4107-babe-f92076e1b7a6" released by "delete_volume" :: held 1.465s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:35:12 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Created reservations ['6e02ba0f-8922-4fae-93b2-eca2a8ad12f5', 'c563ca7c-b806-4fbe-8c5a-8d6633f7c3ab', 'c15ccd28-9137-451c-95e6-12f11c36c3d2', 'cd06c8df-73db-4567-bd18-7bae444baf31'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:35:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:35:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:35:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:12 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:35:12 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:12 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6569c9-8fba-4282-8080-9e31571b53ce]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:35:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:13 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b Jun 01 09:35:13 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Acquiring lock "cinder-99f63e9f-4f00-43f6-9199-89a0326b228a-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:35:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Lock "cinder-99f63e9f-4f00-43f6-9199-89a0326b228a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:35:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Acquiring lock "cinder-quobyte-99f63e9f-4f00-43f6-9199-89a0326b228a" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:35:13 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.787s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:13 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:35:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Lock "cinder-quobyte-99f63e9f-4f00-43f6-9199-89a0326b228a" acquired by "delete_volume" :: waited 0.062s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:35:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Deleted volume successfully. Jun 01 09:35:13 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acbd378-3abd-48ae-91ec-022e0b496cfe]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:35:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-99f63e9f-4f00-43f6-9199-89a0326b228a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b63c75d9-7253-432d-a138-af3bda526fc5 tempest-VolumesTestJSON-898103957 None] Lock "cinder-22672d5d-e694-4107-babe-f92076e1b7a6-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:35:13 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-99f63e9f-4f00-43f6-9199-89a0326b228a Jun 01 09:35:13 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:13 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b" returned: 0 in 1.005s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:14 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2378ca22-cf56-415e-93d9-c066d84f7124]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:35:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:14 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b Jun 01 09:35:14 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:14 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-99f63e9f-4f00-43f6-9199-89a0326b228a" returned: 0 in 0.855s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-99f63e9f-4f00-43f6-9199-89a0326b228a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:14 devstack sudo[94657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-99f63e9f-4f00-43f6-9199-89a0326b228a Jun 01 09:35:14 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:14 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b" returned: 0 in 0.777s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.fae0ba81-bcfa-4630-b96c-bb3151764fc6514mvpst.img {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:14 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.fae0ba81-bcfa-4630-b96c-bb3151764fc6514mvpst.img Jun 01 09:35:14 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:14 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-99f63e9f-4f00-43f6-9199-89a0326b228a" returned: 0 in 0.629s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Lock "cinder-quobyte-99f63e9f-4f00-43f6-9199-89a0326b228a" released by "delete_volume" :: held 1.575s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:35:14 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Created reservations ['0544fc75-5c50-4d05-89e5-8bc47e8a320c', 'c40f3e47-2d9e-4320-b25f-2f014744c6a8', '9dafc368-ee72-4235-bdee-2ea704a1987d', 'c86cac76-db57-427c-93c4-df5ba0adae48'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:35:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:35:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:35:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:15 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:35:15 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:16 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.193s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:16 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:35:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Deleted volume successfully. Jun 01 09:35:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32862499-2cf4-409a-8cb0-e5a64a6f2cca tempest-VolumesTestJSON-898103957 None] Lock "cinder-99f63e9f-4f00-43f6-9199-89a0326b228a-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:35:20 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.fae0ba81-bcfa-4630-b96c-bb3151764fc6514mvpst.img" returned: 0 in 6.131s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:20 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3513d5b4-5595-4220-ad70-46d01f152f6a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:35:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:21 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b Jun 01 09:35:21 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:21 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b" returned: 0 in 1.027s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:21 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] Image conversion details: src /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.fae0ba81-bcfa-4630-b96c-bb3151764fc6514mvpst.img {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:35:21 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] Converted 1024.00 MB image at 166.93 MB/s Jun 01 09:35:22 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] fae0ba81-bcfa-4630-b96c-bb3151764fc6 was raw, no need to convert to raw {{(pid=86649) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Jun 01 09:35:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-339f9ea1-f278-42cb-9a12-ea21cb7c5f12 tempest-BackendsCapabilitiesAdminTestsJSON-263885673 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86649) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 01 09:35:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-18cdf14c-5262-42a3-8b13-9d45161af393 tempest-BackendsCapabilitiesAdminTestsJSON-263885673 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86649) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 01 09:35:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-dcf7e76b-0ee3-46ec-930e-343d20997436 req-8d4c442d-b969-48ff-a468-26cd2d4d2b64 tempest-AttachVolumeShelveTestJSON-959099849 None] No connector for attachment 621b3d8f-6e83-42c4-a2c2-f977913d3cd1; skipping storage backend terminate_connection call. {{(pid=86649) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 01 09:35:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-dcf7e76b-0ee3-46ec-930e-343d20997436 req-8d4c442d-b969-48ff-a468-26cd2d4d2b64 tempest-AttachVolumeShelveTestJSON-959099849 None] Deleting attachment 621b3d8f-6e83-42c4-a2c2-f977913d3cd1. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:35:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c1468aba-817c-4c4b-9611-919993208f15 tempest-GroupSnapshotsTest-968639615 None] Group tempest-GroupSnapshotsTest-Group-545215189: creating Jun 01 09:35:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c1468aba-817c-4c4b-9611-919993208f15 tempest-GroupSnapshotsTest-968639615 None] Group tempest-GroupSnapshotsTest-Group-545215189: created successfully Jun 01 09:35:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c1468aba-817c-4c4b-9611-919993208f15 tempest-GroupSnapshotsTest-968639615 None] Create group completed successfully. Jun 01 09:35:31 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:35:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Flow 'volume_create_manager' (78fc9686-3027-45e2-8699-e8b1280fba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:35:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e342029d-df30-407f-9184-202e2b9e26c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e342029d-df30-407f-9184-202e2b9e26c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1296587532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a39e7c2b-a97f-43c7-b97e-8bd50ef5c466,host='devstack@QuobyteHD#QuobyteHD',id=ad9bb65b-7288-4107-aa78-cad2557b170f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d397ee81ed5045f28a617f1bb86ef93e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:35:32Z,use_quota=True,user_id='d44448a124b746d898c46fb005ebd36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1dfc466-e4de-428f-8540-af6d15ec7f9f),volume_type_id=a1dfc466-e4de-428f-8540-af6d15ec7f9f)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ef2ac7-5b03-4ac5-a860-656e200edff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ef2ac7-5b03-4ac5-a860-656e200edff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24409702-2000-404e-9981-08a3df5d82ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24409702-2000-404e-9981-08a3df5d82ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad9bb65b-7288-4107-aa78-cad2557b170f', 'volume_name': 'volume-ad9bb65b-7288-4107-aa78-cad2557b170f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96031e70-adac-450e-adc8-800dfad378fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96031e70-adac-450e-adc8-800dfad378fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c90071-bd49-433a-8827-875545d106bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:32 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Volume ad9bb65b-7288-4107-aa78-cad2557b170f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad9bb65b-7288-4107-aa78-cad2557b170f', 'volume_size': 1} Jun 01 09:35:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:35:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:35:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:35:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:36 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:35:36 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:37 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.733s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:35:41 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=47,cinder:INSERT=14,cinder:UPDATE=70,cinder:DELETE=7 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:35:42 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=59,cinder:INSERT=20,cinder:UPDATE=73,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:35:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.761s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] Uploaded volume to glance image-id: fae0ba81-bcfa-4630-b96c-bb3151764fc6. {{(pid=86649) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 01 09:35:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.690s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a39e7c2b-a97f-43c7-b97e-8bd50ef5c466,created_at=2026-06-01T07:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1296587532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a39e7c2b-a97f-43c7-b97e-8bd50ef5c466,host='devstack@QuobyteHD#QuobyteHD',id=ad9bb65b-7288-4107-aa78-cad2557b170f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d397ee81ed5045f28a617f1bb86ef93e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:35:32Z,use_quota=True,user_id='d44448a124b746d898c46fb005ebd36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1dfc466-e4de-428f-8540-af6d15ec7f9f),volume_type_id=a1dfc466-e4de-428f-8540-af6d15ec7f9f)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:35:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Creating volume ad9bb65b-7288-4107-aa78-cad2557b170f {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:35:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:35:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:35:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:35:43 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:35:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:43 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f 1073741824 Jun 01 09:35:43 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9f5bc8ba-229d-42fd-81c7-ea618987ce9c tempest-VolumesActionsTest-603787341 None] Copy volume to image completed successfully. Jun 01 09:35:44 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f 1073741824" returned: 0 in 0.892s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:44 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f Jun 01 09:35:44 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:45 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f" returned: 0 in 0.597s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:35:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.264s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c90071-bd49-433a-8827-875545d106bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad9bb65b-7288-4107-aa78-cad2557b170f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ac90b4-714e-4769-b4eb-4a8fdce0e61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:35:45 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a21f09f-e3da-49fb-87d5-bc3aa0a44416]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:35:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:45 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Volume volume-ad9bb65b-7288-4107-aa78-cad2557b170f (ad9bb65b-7288-4107-aa78-cad2557b170f): created successfully Jun 01 09:35:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ac90b4-714e-4769-b4eb-4a8fdce0e61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:35:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Flow 'volume_create_manager' (78fc9686-3027-45e2-8699-e8b1280fba16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:35:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d6be68d8-756d-4450-9714-b93349c3bc36 tempest-GroupSnapshotsTest-968639615 None] Created volume successfully. Jun 01 09:35:45 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b Jun 01 09:35:45 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:46 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b" returned: 0 in 0.725s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec6e0d6-7684-4368-9b04-dba7b9af0491]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:35:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:46 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b Jun 01 09:35:46 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] GroupSnapshot b3da318f-f92e-4ad6-aa24-3b72b33c8685: creating. Jun 01 09:35:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] Group snapshot b3da318f-f92e-4ad6-aa24-3b72b33c8685: creating. {{(pid=86649) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 01 09:35:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:35:46 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b" returned: 0 in 0.702s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:46 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img Jun 01 09:35:46 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:53 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img" returned: 0 in 6.453s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:53 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b114365-84be-4c8a-8289-5056d9ceb2e5]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:35:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:53 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b Jun 01 09:35:53 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:54 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b" returned: 0 in 0.886s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:54 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Image conversion details: src /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:35:54 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Converted 1024.00 MB image at 158.66 MB/s Jun 01 09:35:54 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] 10c57f57-3e92-42a0-a8f8-fc8800121c72 was raw, converting to qcow2 {{(pid=86649) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Jun 01 09:35:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[86519440-5211-4514-ad99-f2f39a79f698]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:35:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:54 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img Jun 01 09:35:54 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:54 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img" returned: 0 in 0.679s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:54 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img Jun 01 09:35:54 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:55 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img" returned: 1 in 0.675s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:35:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img /opt/stack/data/cinder/conversion/vol_upload_i6jgfll_ {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:55 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img /opt/stack/data/cinder/conversion/vol_upload_i6jgfll_ Jun 01 09:35:55 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:56 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img /opt/stack/data/cinder/conversion/vol_upload_i6jgfll_" returned: 0 in 0.611s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:56 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Image conversion details: src /opt/stack/data/cinder/conversion/593b69be-e600-4c48-9072-1603b075201b.temp_image.10c57f57-3e92-42a0-a8f8-fc8800121c729kwfb6on.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_i6jgfll_ {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:35:56 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 01 09:35:56 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcce150-bdf0-4367-923a-b4038c9697ac]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:35:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i6jgfll_ {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:56 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i6jgfll_ Jun 01 09:35:56 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:56 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:35:56 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i6jgfll_" returned: 0 in 0.674s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.715s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:35:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Uploaded volume to glance image-id: 10c57f57-3e92-42a0-a8f8-fc8800121c72. {{(pid=86649) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 01 09:35:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.295s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:35:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] Creating offline snapshot 80184de6-9b03-4db3-b184-2bd6d31d05f1 of volume ad9bb65b-7288-4107-aa78-cad2557b170f {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:35:58 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ce3af1a0-d93a-4306-87e7-5009643551c5 tempest-VolumesActionsTest-603787341 None] Copy volume to image completed successfully. Jun 01 09:35:58 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[637d912f-a7c0-4b31-8ee1-d60e7836cb4c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:35:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:58 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f Jun 01 09:35:58 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:58 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f" returned: 0 in 0.735s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:58 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 1G Jun 01 09:35:58 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Acquiring lock "cinder-593b69be-e600-4c48-9072-1603b075201b-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:35:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Lock "cinder-593b69be-e600-4c48-9072-1603b075201b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:35:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Acquiring lock "cinder-quobyte-593b69be-e600-4c48-9072-1603b075201b" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:35:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Lock "cinder-quobyte-593b69be-e600-4c48-9072-1603b075201b" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:35:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c42c27e-1e42-4827-8621-96840c539390]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:35:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:59 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b Jun 01 09:35:59 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:35:59 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Jun 01 09:35:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 1G" returned: 0 in 0.837s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:35:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad9bb65b-7288-4107-aa78-cad2557b170f -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:35:59 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad9bb65b-7288-4107-aa78-cad2557b170f -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 Jun 01 09:35:59 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:00 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b" returned: 0 in 0.723s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:00 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b Jun 01 09:36:00 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:00 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad9bb65b-7288-4107-aa78-cad2557b170f -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1" returned: 0 in 0.674s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:00 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 is being set with open permissions: ugo+rw: NotImplementedError Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:00 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 Jun 01 09:36:00 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:00 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-593b69be-e600-4c48-9072-1603b075201b" returned: 0 in 0.629s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Lock "cinder-quobyte-593b69be-e600-4c48-9072-1603b075201b" released by "delete_volume" :: held 1.391s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Created reservations ['7c2fa900-4144-4831-b99f-f73c840b4457', '65e2ea96-e118-4312-a038-1a92140cd0be', 'fdb720f3-8719-4350-b9c9-b49dbd777e34', '5591ad2d-41ae-4b60-92e0-0b520df9f32a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:00 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1" returned: 0 in 0.602s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:00 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.info Jun 01 09:36:00 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:01 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:36:01 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:01 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.info" returned: 0 in 0.656s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:01 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.info is being set with open permissions: ugo+rw: NotImplementedError Jun 01 09:36:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:01 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.info Jun 01 09:36:01 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:01 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.650s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:01 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:36:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Deleted volume successfully. Jun 01 09:36:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d0a4980-5b1d-4487-b340-34d17d5b1675 tempest-VolumesActionsTest-603787341 None] Lock "cinder-593b69be-e600-4c48-9072-1603b075201b-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:02 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.info" returned: 0 in 0.666s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.274s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:02 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a283cad1-6cac-42b9-83c1-8c20358e1151 tempest-GroupSnapshotsTest-968639615 None] group_snapshot b3da318f-f92e-4ad6-aa24-3b72b33c8685: created successfully Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-80184de6-9b03-4db3-b184-2bd6d31d05f1-0d984ef1-3e0d-4748-9246-927ee62fde5f" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-80184de6-9b03-4db3-b184-2bd6d31d05f1-0d984ef1-3e0d-4748-9246-927ee62fde5f" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Creating volume 0d984ef1-3e0d-4748-9246-927ee62fde5f from snapshot 80184de6-9b03-4db3-b184-2bd6d31d05f1 {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-0d984ef1-3e0d-4748-9246-927ee62fde5f" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-0d984ef1-3e0d-4748-9246-927ee62fde5f" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] snapshot: 80184de6-9b03-4db3-b184-2bd6d31d05f1, volume: 0d984ef1-3e0d-4748-9246-927ee62fde5f, {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed6f1bf-414d-4433-a745-7f91d7d5e9f8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:04 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 Jun 01 09:36:04 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:04 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1" returned: 0 in 0.728s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad9bb65b-7288-4107-aa78-cad2557b170f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:36:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 01 09:36:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 01 09:36:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9db320-82f0-45b2-a6a4-7a2504f06bdc]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:04 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f Jun 01 09:36:04 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:05 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f" returned: 0 in 0.740s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:05 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Path /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 01 09:36:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:05 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f Jun 01 09:36:05 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:08 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:36:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Flow 'volume_create_manager' (4f406b6a-d3b9-4363-b02e-0ff829e93c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:36:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c641545f-7418-4805-b532-c3a27e69bc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c641545f-7418-4805-b532-c3a27e69bc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-860882905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11fe0342-6a95-4726-984c-f13d4fa52536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73af9ce744ee410e9331e25d7094ca7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:36:09Z,use_quota=True,user_id='f18862f314074aff9a9601ced62906a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4fca89-ed1b-4233-b605-43f61d1cd4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4fca89-ed1b-4233-b605-43f61d1cd4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eca2cef-9d4a-4c3e-817d-571366f9fb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eca2cef-9d4a-4c3e-817d-571366f9fb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11fe0342-6a95-4726-984c-f13d4fa52536', 'volume_name': 'volume-11fe0342-6a95-4726-984c-f13d4fa52536', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cc9fe5-6f6c-4ca0-b0e4-5eb8bebeb9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cc9fe5-6f6c-4ca0-b0e4-5eb8bebeb9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711541a7-6674-4aaf-aaba-a0fde9e67a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:08 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Volume 11fe0342-6a95-4726-984c-f13d4fa52536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11fe0342-6a95-4726-984c-f13d4fa52536', 'volume_size': 1} Jun 01 09:36:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:11 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f" returned: 0 in 5.674s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:11 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc54dc4-3ed2-407f-8c10-1b8f9ca07a6b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:11 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f Jun 01 09:36:11 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:11 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f" returned: 0 in 0.875s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:11 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Image conversion details: src /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:36:11 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Converted 1024.00 MB image at 180.41 MB/s Jun 01 09:36:11 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f is being set with open permissions: ugo+rw: NotImplementedError Jun 01 09:36:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:12 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f Jun 01 09:36:12 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:12 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f" returned: 0 in 0.699s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-0d984ef1-3e0d-4748-9246-927ee62fde5f" released by "_copy_volume_from_snapshot" :: held 8.820s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-80184de6-9b03-4db3-b184-2bd6d31d05f1-0d984ef1-3e0d-4748-9246-927ee62fde5f" released by "_create_volume_from_snapshot" :: held 8.857s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.882s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.876s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-860882905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11fe0342-6a95-4726-984c-f13d4fa52536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73af9ce744ee410e9331e25d7094ca7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:36:09Z,use_quota=True,user_id='f18862f314074aff9a9601ced62906a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:36:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Creating volume 11fe0342-6a95-4726-984c-f13d4fa52536 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:36:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:36:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:36:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:36:12 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:36:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:12 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536 1073741824 Jun 01 09:36:12 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:12 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c4a17d7b-fec0-4297-a5b9-df78e13e1389 tempest-GroupSnapshotsTest-968639615 None] Create group from source-snapshot-b3da318f-f92e-4ad6-aa24-3b72b33c8685 completed successfully. Jun 01 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-0d984ef1-3e0d-4748-9246-927ee62fde5f" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-0d984ef1-3e0d-4748-9246-927ee62fde5f" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:13 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b158686e-250f-4e8d-baf0-ac749ec8a2b8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:13 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536 1073741824" returned: 0 in 0.872s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:13 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536 Jun 01 09:36:13 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:13 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f Jun 01 09:36:13 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:14 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536" returned: 0 in 0.705s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:36:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711541a7-6674-4aaf-aaba-a0fde9e67a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11fe0342-6a95-4726-984c-f13d4fa52536', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0a57ca-78fd-4535-a076-fe613b152857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:14 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Volume volume-11fe0342-6a95-4726-984c-f13d4fa52536 (11fe0342-6a95-4726-984c-f13d4fa52536): created successfully Jun 01 09:36:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0a57ca-78fd-4535-a076-fe613b152857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Flow 'volume_create_manager' (4f406b6a-d3b9-4363-b02e-0ff829e93c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:36:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ec52f3e4-ef55-49c4-956e-9c4b158c5241 tempest-VolumesSnapshotListTestJSON-1843421467 None] Created volume successfully. Jun 01 09:36:14 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f" returned: 0 in 0.838s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:14 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f Jun 01 09:36:14 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:14 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d984ef1-3e0d-4748-9246-927ee62fde5f" returned: 0 in 0.583s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-0d984ef1-3e0d-4748-9246-927ee62fde5f" released by "delete_volume" :: held 1.475s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Created reservations ['5229e140-8cc3-4b8c-bec7-357e8193fd6f'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:15 devstack cinder-volume[86649]: WARNING cinder.quota [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-355142512 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-355142512, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:36:15 devstack cinder-volume[86649]: WARNING cinder.quota [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-355142512 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-355142512, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Created reservations ['ef500413-649d-4b64-b8a3-b4c364978814', 'd183eadf-598c-481f-96d8-3191450311e7', '60bc246d-b8c1-48da-9868-c9b947e8b772', '7b4d2376-68fe-4ab4-8736-7b45a35394cd'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:15 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:36:15 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] Creating offline snapshot a1d410e1-3902-407a-93e4-f3c42015d215 of volume 11fe0342-6a95-4726-984c-f13d4fa52536 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c4d6a5-8ba0-49e6-9fa4-63690fb091fa]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:15 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536 Jun 01 09:36:15 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:15 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.634s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:36:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fc8da0c3-738d-4286-923b-562cbfa4b51a tempest-GroupSnapshotsTest-968639615 None] Delete group completed successfully. Jun 01 09:36:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] group_snapshot b3da318f-f92e-4ad6-aa24-3b72b33c8685: deleting Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] group_snapshot b3da318f-f92e-4ad6-aa24-3b72b33c8685: deleting {{(pid=86649) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-ad9bb65b-7288-4107-aa78-cad2557b170f" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-ad9bb65b-7288-4107-aa78-cad2557b170f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-80184de6-9b03-4db3-b184-2bd6d31d05f1" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-80184de6-9b03-4db3-b184-2bd6d31d05f1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] Deleting offline snapshot 80184de6-9b03-4db3-b184-2bd6d31d05f1 of volume ad9bb65b-7288-4107-aa78-cad2557b170f {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:36:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] snapshot_file for this snap is: volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:36:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e4d569-b010-4587-b541-db2552541a86]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:16 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 Jun 01 09:36:16 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:16 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536" returned: 0 in 0.851s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:16 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 1G Jun 01 09:36:16 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:16 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1" returned: 0 in 0.786s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad9bb65b-7288-4107-aa78-cad2557b170f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:36:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e2bd32-42ef-4bb6-aecf-004a9fb8085b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:16 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f Jun 01 09:36:16 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:17 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 1G" returned: 0 in 0.770s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11fe0342-6a95-4726-984c-f13d4fa52536 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:17 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11fe0342-6a95-4726-984c-f13d4fa52536 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 Jun 01 09:36:17 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:17 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f" returned: 0 in 0.768s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:17 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 Jun 01 09:36:17 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:17 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11fe0342-6a95-4726-984c-f13d4fa52536 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215" returned: 0 in 0.744s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:17 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 is being set with open permissions: ugo+rw Jun 01 09:36:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:17 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 Jun 01 09:36:17 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:18 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1" returned: 0 in 0.694s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:18 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1 Jun 01 09:36:18 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:18 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215" returned: 0 in 0.610s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:18 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.info Jun 01 09:36:18 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:18 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f.80184de6-9b03-4db3-b184-2bd6d31d05f1" returned: 0 in 0.621s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-80184de6-9b03-4db3-b184-2bd6d31d05f1" released by "_delete_snapshot" :: held 2.996s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-ad9bb65b-7288-4107-aa78-cad2557b170f" released by "delete_snapshot" :: held 3.020s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:19 devstack cinder-volume[86649]: WARNING cinder.quota [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-355142512 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-355142512, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] Created reservations ['662e0c35-de75-4416-b83f-a2bb6e08e452', 'd203c1c8-0deb-49e1-abca-6522f0b6b1d8', '3b7524a3-51f7-48af-8bc9-e423b9a00969', '579dd246-1def-4aac-becd-55dbfc379db8'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:19 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.info" returned: 0 in 0.669s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:19 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.info is being set with open permissions: ugo+rw Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:19 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.info Jun 01 09:36:19 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fb56e866-a3da-437c-ab96-d26428bded93 tempest-GroupSnapshotsTest-968639615 None] group_snapshot b3da318f-f92e-4ad6-aa24-3b72b33c8685: deleted successfully Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Acquiring lock "cinder-551cff51-10f4-4e49-8ddf-ee04ed604c06-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "cinder-551cff51-10f4-4e49-8ddf-ee04ed604c06-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Acquiring lock "cinder-quobyte-551cff51-10f4-4e49-8ddf-ee04ed604c06" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "cinder-quobyte-551cff51-10f4-4e49-8ddf-ee04ed604c06" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dbc063-bce4-4edf-9bad-d0108f365838]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-551cff51-10f4-4e49-8ddf-ee04ed604c06 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-ad9bb65b-7288-4107-aa78-cad2557b170f" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-ad9bb65b-7288-4107-aa78-cad2557b170f" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2c2a02-c189-459a-8896-7f63640a593f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:19 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-551cff51-10f4-4e49-8ddf-ee04ed604c06 Jun 01 09:36:19 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:19 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f Jun 01 09:36:19 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:19 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.info" returned: 0 in 0.682s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.445s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-bb379061-888e-4d30-8510-1e97290cfaf2 tempest-VolumesSnapshotListTestJSON-1843421467 None] Create snapshot completed successfully Jun 01 09:36:20 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-551cff51-10f4-4e49-8ddf-ee04ed604c06" returned: 0 in 0.753s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-551cff51-10f4-4e49-8ddf-ee04ed604c06 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:20 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-551cff51-10f4-4e49-8ddf-ee04ed604c06 Jun 01 09:36:20 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:20 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f" returned: 0 in 0.703s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:20 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f Jun 01 09:36:20 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] Creating offline snapshot a070efad-5479-41d7-9585-d8b82cc7d85b of volume 11fe0342-6a95-4726-984c-f13d4fa52536 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:36:20 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-551cff51-10f4-4e49-8ddf-ee04ed604c06" returned: 0 in 0.611s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "cinder-quobyte-551cff51-10f4-4e49-8ddf-ee04ed604c06" released by "delete_volume" :: held 1.431s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[beee1251-3050-45bc-bab4-b1bd280f579c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:20 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ad9bb65b-7288-4107-aa78-cad2557b170f" returned: 0 in 0.601s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-ad9bb65b-7288-4107-aa78-cad2557b170f" released by "delete_volume" :: held 1.375s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Created reservations ['9a5dfcd6-caf9-444d-b707-c9e5d4738544', 'a07380b5-7a6b-4161-a0e1-704eaa0bea3d', '9240aa5b-bd9b-4a20-9b79-b490dc62840b', '6ff40637-8a01-479c-a812-7b45a0ee22c2'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Created reservations ['8625445f-efcc-443f-8d54-1360dc4bb0b5'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:20 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 Jun 01 09:36:20 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:21 devstack cinder-volume[86649]: WARNING cinder.db.sqlalchemy.api [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-355142512'] Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Created reservations ['9710e989-ae90-4c30-aaa7-520a06048166', 'e4988e58-2ca5-42a0-b0fe-6c9904e129ba', '3772fb9e-34ce-4040-a263-9392b4ba7c2d', '066531fc-03c9-4d73-9119-65620b3d9fb6'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:21 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:36:21 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:21 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:36:21 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:21 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215" returned: 0 in 0.726s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11fe0342-6a95-4726-984c-f13d4fa52536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:21 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b 1G Jun 01 09:36:21 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Acquiring lock "cinder-df587df9-9cf4-41b5-9d59-2d7a1980e5de-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:21 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.702s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:36:21 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Deleted volume successfully. Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "cinder-df587df9-9cf4-41b5-9d59-2d7a1980e5de-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-671600ad-f468-4f01-a803-ca49d5237a44 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "cinder-551cff51-10f4-4e49-8ddf-ee04ed604c06-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:21 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.654s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:36:21 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fc84f168-b6cf-414b-8076-83fadf8c2557 tempest-GroupSnapshotsTest-968639615 None] Delete group completed successfully. Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Acquiring lock "cinder-quobyte-df587df9-9cf4-41b5-9d59-2d7a1980e5de" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "cinder-quobyte-df587df9-9cf4-41b5-9d59-2d7a1980e5de" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7164d6-06d4-482a-8228-8d81a2925ce1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:21 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de Jun 01 09:36:21 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-abc602cd-ea5a-469b-8bad-72dde2573bec tempest-GroupSnapshotsTest-968639615 None] Group tempest-GroupSnapshotsTest-Group-392947402: creating Jun 01 09:36:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-abc602cd-ea5a-469b-8bad-72dde2573bec tempest-GroupSnapshotsTest-968639615 None] Group tempest-GroupSnapshotsTest-Group-392947402: created successfully Jun 01 09:36:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-abc602cd-ea5a-469b-8bad-72dde2573bec tempest-GroupSnapshotsTest-968639615 None] Create group completed successfully. Jun 01 09:36:22 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b 1G" returned: 0 in 0.910s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:22 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b Jun 01 09:36:22 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:22 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de" returned: 0 in 0.718s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:22 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de Jun 01 09:36:22 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:23 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b" returned: 0 in 0.638s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:23 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b is being set with open permissions: ugo+rw Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:23 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b Jun 01 09:36:23 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:23 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df587df9-9cf4-41b5-9d59-2d7a1980e5de" returned: 0 in 0.588s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "cinder-quobyte-df587df9-9cf4-41b5-9d59-2d7a1980e5de" released by "delete_volume" :: held 1.364s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Created reservations ['5b183165-3fd2-4885-a471-e39b9f906975', 'bcd08389-f415-44e4-a201-b77f9b18b683', '8701d575-ac13-46bf-8194-7e1da5a79a22', 'b517b266-e51c-40da-b5e1-37596989e4be'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:23 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:36:23 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:23 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Flow 'volume_create_manager' (73fa1b54-0033-4e4d-9a15-11d3b9aaf16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20619d5-caa9-4ba2-8605-a47cc426138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b" returned: 0 in 0.682s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20619d5-caa9-4ba2-8605-a47cc426138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-824776401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d9a46403-53aa-4b2c-90e9-95b83c2e115d,host='devstack@QuobyteHD#QuobyteHD',id=cb710445-5074-4fc2-8936-d489970485e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d397ee81ed5045f28a617f1bb86ef93e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:36:24Z,use_quota=True,user_id='d44448a124b746d898c46fb005ebd36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c81cf80e-3721-4756-89dc-0a4190f687b5),volume_type_id=c81cf80e-3721-4756-89dc-0a4190f687b5)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ca9b1d-ebc3-40b2-b65b-b6f811846e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ca9b1d-ebc3-40b2-b65b-b6f811846e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19564b0d-ab01-4398-a29e-82ae8bec3c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19564b0d-ab01-4398-a29e-82ae8bec3c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb710445-5074-4fc2-8936-d489970485e4', 'volume_name': 'volume-cb710445-5074-4fc2-8936-d489970485e4', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d43f18-e402-4318-8c56-70000f0ba7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d43f18-e402-4318-8c56-70000f0ba7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259af232-5579-481e-be6d-675886e960ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:23 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Volume cb710445-5074-4fc2-8936-d489970485e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb710445-5074-4fc2-8936-d489970485e4', 'volume_size': 1} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.124s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.038s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d9a46403-53aa-4b2c-90e9-95b83c2e115d,created_at=2026-06-01T07:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-824776401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d9a46403-53aa-4b2c-90e9-95b83c2e115d,host='devstack@QuobyteHD#QuobyteHD',id=cb710445-5074-4fc2-8936-d489970485e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d397ee81ed5045f28a617f1bb86ef93e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:36:24Z,use_quota=True,user_id='d44448a124b746d898c46fb005ebd36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c81cf80e-3721-4756-89dc-0a4190f687b5),volume_type_id=c81cf80e-3721-4756-89dc-0a4190f687b5)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Creating volume cb710445-5074-4fc2-8936-d489970485e4 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:36:23 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:36:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:23 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4 1073741824 Jun 01 09:36:23 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4312f46f-5390-4afa-b505-85203f11276f tempest-VolumesSnapshotListTestJSON-1843421467 None] Create snapshot completed successfully Jun 01 09:36:24 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.724s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:24 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:36:24 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Deleted volume successfully. Jun 01 09:36:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2b1a21e0-a76f-47c2-941f-f96cbfe9d058 tempest-AttachVolumeShelveTestJSON-959099849 None] Lock "cinder-df587df9-9cf4-41b5-9d59-2d7a1980e5de-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:24 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4 1073741824" returned: 0 in 0.778s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:24 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4 Jun 01 09:36:24 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:25 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4" returned: 0 in 0.604s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:36:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.153s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259af232-5579-481e-be6d-675886e960ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb710445-5074-4fc2-8936-d489970485e4', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0a4922-9cbb-45ef-acde-fd5e8d0abada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] Creating offline snapshot 721b2724-437a-4ac7-81bb-b353e60c4df9 of volume 11fe0342-6a95-4726-984c-f13d4fa52536 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:36:25 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Volume volume-cb710445-5074-4fc2-8936-d489970485e4 (cb710445-5074-4fc2-8936-d489970485e4): created successfully Jun 01 09:36:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0a4922-9cbb-45ef-acde-fd5e8d0abada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Flow 'volume_create_manager' (73fa1b54-0033-4e4d-9a15-11d3b9aaf16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:36:25 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df3e32b-47c3-4b80-9e7a-ef5aa8203ca1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-912fffef-cfa9-40a1-ad25-b2207936a875 tempest-GroupSnapshotsTest-968639615 None] Created volume successfully. Jun 01 09:36:25 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b Jun 01 09:36:25 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:26 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b" returned: 0 in 0.798s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11fe0342-6a95-4726-984c-f13d4fa52536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:26 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 1G Jun 01 09:36:26 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Flow 'volume_create_manager' (6662b833-1be0-41f9-9fc7-c39be10a7260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3107c43-f7ae-4dba-a295-3c2081863553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3107c43-f7ae-4dba-a295-3c2081863553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1752963863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d9a46403-53aa-4b2c-90e9-95b83c2e115d,host='devstack@QuobyteHD#QuobyteHD',id=b0ce357f-de22-41de-bea0-77eb9ec1daf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d397ee81ed5045f28a617f1bb86ef93e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:36:26Z,use_quota=True,user_id='d44448a124b746d898c46fb005ebd36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c81cf80e-3721-4756-89dc-0a4190f687b5),volume_type_id=c81cf80e-3721-4756-89dc-0a4190f687b5)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067a0c63-529f-4545-95a0-d0059a0f18eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067a0c63-529f-4545-95a0-d0059a0f18eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fd02f0-c20d-4772-8b85-885e0c29d1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fd02f0-c20d-4772-8b85-885e0c29d1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0ce357f-de22-41de-bea0-77eb9ec1daf9', 'volume_name': 'volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff99a73-854c-4ffb-841a-2d5f033b02ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff99a73-854c-4ffb-841a-2d5f033b02ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9cdab0-a246-4af3-b55c-a37ebb0fae3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:26 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Volume b0ce357f-de22-41de-bea0-77eb9ec1daf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9', 'volume_size': 1} Jun 01 09:36:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:27 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 1G" returned: 0 in 1.030s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:27 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 Jun 01 09:36:27 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:28 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9" returned: 0 in 0.732s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:28 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 is being set with open permissions: ugo+rw Jun 01 09:36:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:28 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 Jun 01 09:36:28 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:28 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9" returned: 0 in 0.634s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.345s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.084s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d9a46403-53aa-4b2c-90e9-95b83c2e115d,created_at=2026-06-01T07:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1752963863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d9a46403-53aa-4b2c-90e9-95b83c2e115d,host='devstack@QuobyteHD#QuobyteHD',id=b0ce357f-de22-41de-bea0-77eb9ec1daf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d397ee81ed5045f28a617f1bb86ef93e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:36:26Z,use_quota=True,user_id='d44448a124b746d898c46fb005ebd36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c81cf80e-3721-4756-89dc-0a4190f687b5),volume_type_id=c81cf80e-3721-4756-89dc-0a4190f687b5)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:36:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Creating volume b0ce357f-de22-41de-bea0-77eb9ec1daf9 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:36:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:36:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:36:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:36:28 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:36:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:28 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 1073741824 Jun 01 09:36:28 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ec30e040-b78a-45db-b1dc-a6232fd8afdf tempest-VolumesSnapshotListTestJSON-1843421467 None] Create snapshot completed successfully Jun 01 09:36:29 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 1073741824" returned: 0 in 0.888s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:29 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 Jun 01 09:36:29 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "cinder-721b2724-437a-4ac7-81bb-b353e60c4df9-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-721b2724-437a-4ac7-81bb-b353e60c4df9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "cinder-quobyte-11fe0342-6a95-4726-984c-f13d4fa52536" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-quobyte-11fe0342-6a95-4726-984c-f13d4fa52536" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "cinder-quobyte-721b2724-437a-4ac7-81bb-b353e60c4df9" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-quobyte-721b2724-437a-4ac7-81bb-b353e60c4df9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Deleting offline snapshot 721b2724-437a-4ac7-81bb-b353e60c4df9 of volume 11fe0342-6a95-4726-984c-f13d4fa52536 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] snapshot_file for this snap is: volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:36:30 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9" returned: 0 in 0.738s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[31022f86-6416-400b-820c-54652b3b3709]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9cdab0-a246-4af3-b55c-a37ebb0fae3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785aa7ab-59d9-46b4-9e12-ebd74ff96346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:36:30 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Volume volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 (b0ce357f-de22-41de-bea0-77eb9ec1daf9): created successfully Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785aa7ab-59d9-46b4-9e12-ebd74ff96346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:36:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Flow 'volume_create_manager' (6662b833-1be0-41f9-9fc7-c39be10a7260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:36:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5ad9be70-c3a9-4f58-8d0a-fcdd74b03e23 tempest-GroupSnapshotsTest-968639615 None] Created volume successfully. Jun 01 09:36:30 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 Jun 01 09:36:30 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7b20fc0e-ce61-4a0d-baab-68fb2a5766c3 tempest-GroupSnapshotsTest-968639615 None] Update group completed successfully. Jun 01 09:36:31 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9" returned: 0 in 0.833s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11fe0342-6a95-4726-984c-f13d4fa52536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:36:31 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9bf2dc-d974-4a94-b7c2-71e65dad8a3b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:31 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b Jun 01 09:36:31 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:32 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b" returned: 0 in 0.755s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11fe0342-6a95-4726-984c-f13d4fa52536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:36:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:32 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 Jun 01 09:36:32 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-78ab9b53-bd4b-46d3-b2eb-a44b9591a79d tempest-GroupSnapshotsTest-968639615 None] Update group completed successfully. Jun 01 09:36:32 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9" returned: 0 in 0.862s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:32 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9 Jun 01 09:36:32 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:33 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-db17c7a0-0ae2-4c63-8ae3-42ec876dfbf3 tempest-GroupSnapshotsTest-968639615 None] Update group completed successfully. Jun 01 09:36:33 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.721b2724-437a-4ac7-81bb-b353e60c4df9" returned: 0 in 0.625s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-quobyte-721b2724-437a-4ac7-81bb-b353e60c4df9" released by "_delete_snapshot" :: held 3.170s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-quobyte-11fe0342-6a95-4726-984c-f13d4fa52536" released by "delete_snapshot" :: held 3.196s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:33 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Created reservations ['ae677265-147c-4437-8d15-e58f7b768107', '41b5c255-f702-4c43-b261-daf6ac228a4d', 'c8605cd3-ec77-4585-9ab4-68298de7d204', '46d3a40d-3668-4be6-a8bb-be1a2d7bd2a8'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:33 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Delete snapshot completed successfully. Jun 01 09:36:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2d26007c-6e51-4661-a884-bc628dfd5c11 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-721b2724-437a-4ac7-81bb-b353e60c4df9-delete_snapshot" released by "delete_snapshot" :: held 3.333s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "cinder-a070efad-5479-41d7-9585-d8b82cc7d85b-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-a070efad-5479-41d7-9585-d8b82cc7d85b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "cinder-quobyte-11fe0342-6a95-4726-984c-f13d4fa52536" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-quobyte-11fe0342-6a95-4726-984c-f13d4fa52536" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "cinder-quobyte-a070efad-5479-41d7-9585-d8b82cc7d85b" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-quobyte-a070efad-5479-41d7-9585-d8b82cc7d85b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Deleting offline snapshot a070efad-5479-41d7-9585-d8b82cc7d85b of volume 11fe0342-6a95-4726-984c-f13d4fa52536 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:36:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] snapshot_file for this snap is: volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:36:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bd9e2d-1a61-4b93-a60f-21fb5eabc74a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2823c3ce-8de4-4a59-b2b8-8f8dce3cd5bb tempest-GroupSnapshotsTest-968639615 None] Update group completed successfully. Jun 01 09:36:34 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b Jun 01 09:36:34 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:35 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b" returned: 0 in 0.723s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11fe0342-6a95-4726-984c-f13d4fa52536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:36:35 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[283dcc4f-4cae-4418-b136-faef1c22772a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:35 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 Jun 01 09:36:35 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] GroupSnapshot e11b671b-255b-4165-a376-cb71512ce295: creating. Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Group snapshot e11b671b-255b-4165-a376-cb71512ce295: creating. {{(pid=86649) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Creating offline snapshot 62b4812f-642c-497b-adc3-80c162ff74a1 of volume b0ce357f-de22-41de-bea0-77eb9ec1daf9 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11a455f-30ef-4a90-817e-2697fbbfd092]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:36 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 Jun 01 09:36:36 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:36 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215" returned: 0 in 0.815s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11fe0342-6a95-4726-984c-f13d4fa52536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:36 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b Jun 01 09:36:36 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:36 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:36:36 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:37 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9" returned: 0 in 0.931s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:37 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 1G Jun 01 09:36:37 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:37 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b" returned: 0 in 1.009s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:37 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b Jun 01 09:36:37 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:37 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.733s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:36:37 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a070efad-5479-41d7-9585-d8b82cc7d85b" returned: 0 in 0.708s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:38 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 1G" returned: 0 in 0.934s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-quobyte-a070efad-5479-41d7-9585-d8b82cc7d85b" released by "_delete_snapshot" :: held 3.380s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-quobyte-11fe0342-6a95-4726-984c-f13d4fa52536" released by "delete_snapshot" :: held 3.418s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:38 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 Jun 01 09:36:38 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Created reservations ['c54b53e4-0c53-446f-8a5c-af0fd769d398', 'c67c17db-6e39-48c6-8dfb-3d8a870f1442', 'bf1cf840-8509-4cb2-ab8a-96ee030c8de7', '1b9d5c19-8847-46c5-a198-c2e5ab445607'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:38 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Delete snapshot completed successfully. Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4780a50-3daf-4f3a-879c-591a3e7c0a6e tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-a070efad-5479-41d7-9585-d8b82cc7d85b-delete_snapshot" released by "delete_snapshot" :: held 3.599s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:38 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1" returned: 0 in 0.841s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:38 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 is being set with open permissions: ugo+rw: NotImplementedError Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "cinder-a1d410e1-3902-407a-93e4-f3c42015d215-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:38 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 Jun 01 09:36:38 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-a1d410e1-3902-407a-93e4-f3c42015d215-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "cinder-quobyte-11fe0342-6a95-4726-984c-f13d4fa52536" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-quobyte-11fe0342-6a95-4726-984c-f13d4fa52536" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "cinder-quobyte-a1d410e1-3902-407a-93e4-f3c42015d215" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-quobyte-a1d410e1-3902-407a-93e4-f3c42015d215" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Deleting offline snapshot a1d410e1-3902-407a-93e4-f3c42015d215 of volume 11fe0342-6a95-4726-984c-f13d4fa52536 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] snapshot_file for this snap is: volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c834b86-edb4-4bc5-a52d-3b5fee65798e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:39 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 Jun 01 09:36:39 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:39 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1" returned: 0 in 0.651s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:39 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.info Jun 01 09:36:39 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:39 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215" returned: 0 in 0.774s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11fe0342-6a95-4726-984c-f13d4fa52536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:36:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c1fcc8-096e-41e2-9105-8642c8be2efa]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:39 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536 Jun 01 09:36:39 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:40 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.info" returned: 0 in 0.645s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:40 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.info is being set with open permissions: ugo+rw: NotImplementedError Jun 01 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:40 devstack sudo[95270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.info Jun 01 09:36:40 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:40 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536" returned: 0 in 0.795s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:40 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 Jun 01 09:36:40 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:40 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.info" returned: 0 in 0.649s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.741s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Creating offline snapshot df9aed57-ae09-4463-a648-10ddef49d21c of volume cb710445-5074-4fc2-8936-d489970485e4 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:36:40 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1bf33c-39e8-4e9d-85b7-ded7a5e0d71a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:41 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4 Jun 01 09:36:41 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:41 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215" returned: 0 in 0.718s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:41 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215 Jun 01 09:36:41 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:41 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4" returned: 0 in 0.764s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:41 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c 1G Jun 01 09:36:41 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:41 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536.a1d410e1-3902-407a-93e4-f3c42015d215" returned: 0 in 0.679s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-quobyte-a1d410e1-3902-407a-93e4-f3c42015d215" released by "_delete_snapshot" :: held 3.091s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-quobyte-11fe0342-6a95-4726-984c-f13d4fa52536" released by "delete_snapshot" :: held 3.119s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:42 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=97,cinder:UPDATE=90,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:36:42 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Created reservations ['3edfc471-a2f6-41d3-a281-b2c028161eef', 'f83e0dc3-6934-493a-8195-fb0e8cdd984d', '2b89ba82-54d8-40f5-a0c3-a36d41d0a3d5', '543cbfef-7169-4df2-bb67-2d0ad49a01b3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:42 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Delete snapshot completed successfully. Jun 01 09:36:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-de15fb71-e409-44de-84e7-1821d2db05ad tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-a1d410e1-3902-407a-93e4-f3c42015d215-delete_snapshot" released by "delete_snapshot" :: held 3.270s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:42 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c 1G" returned: 0 in 0.811s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb710445-5074-4fc2-8936-d489970485e4 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:42 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb710445-5074-4fc2-8936-d489970485e4 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c Jun 01 09:36:42 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:43 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb710445-5074-4fc2-8936-d489970485e4 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c" returned: 0 in 0.719s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:43 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c is being set with open permissions: ugo+rw: NotImplementedError Jun 01 09:36:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:43 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c Jun 01 09:36:43 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "cinder-11fe0342-6a95-4726-984c-f13d4fa52536-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-11fe0342-6a95-4726-984c-f13d4fa52536-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "cinder-quobyte-11fe0342-6a95-4726-984c-f13d4fa52536" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-quobyte-11fe0342-6a95-4726-984c-f13d4fa52536" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:43 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6096d06f-048c-471c-83ed-922855414acc]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:43 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536 Jun 01 09:36:43 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:43 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c" returned: 0 in 0.652s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:43 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.info Jun 01 09:36:43 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:44 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536" returned: 0 in 0.742s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:44 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536 Jun 01 09:36:44 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:44 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.info" returned: 0 in 0.625s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:44 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.info is being set with open permissions: ugo+rw: NotImplementedError Jun 01 09:36:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:44 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.info Jun 01 09:36:44 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:44 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-11fe0342-6a95-4726-984c-f13d4fa52536" returned: 0 in 0.676s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-quobyte-11fe0342-6a95-4726-984c-f13d4fa52536" released by "delete_volume" :: held 1.482s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:44 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Created reservations ['eb5bc7d6-ab2b-4e59-91a4-f15425ea3c36', 'b403816e-a7ba-490d-8821-8d5461f29904', '164ddbf0-7b9e-44d8-9553-753c638f1273', '91641398-3797-42c7-a0cc-cf035f6ee916'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:36:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:36:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:44 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:36:44 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:45 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.info" returned: 0 in 0.602s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.279s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c20e32c9-7ec4-4435-962a-b5bfe2aa1574 tempest-GroupSnapshotsTest-968639615 None] group_snapshot e11b671b-255b-4165-a376-cb71512ce295: created successfully Jun 01 09:36:45 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.614s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:45 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:36:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Deleted volume successfully. Jun 01 09:36:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e67d4102-fd45-4b24-a45e-658045b52213 tempest-VolumesSnapshotListTestJSON-1843421467 None] Lock "cinder-11fe0342-6a95-4726-984c-f13d4fa52536-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] group_snapshot e11b671b-255b-4165-a376-cb71512ce295: deleting Jun 01 09:36:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] group_snapshot e11b671b-255b-4165-a376-cb71512ce295: deleting {{(pid=86649) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 01 09:36:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-b0ce357f-de22-41de-bea0-77eb9ec1daf9" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-b0ce357f-de22-41de-bea0-77eb9ec1daf9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-62b4812f-642c-497b-adc3-80c162ff74a1" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-62b4812f-642c-497b-adc3-80c162ff74a1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Deleting offline snapshot 62b4812f-642c-497b-adc3-80c162ff74a1 of volume b0ce357f-de22-41de-bea0-77eb9ec1daf9 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:36:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] snapshot_file for this snap is: volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:36:45 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccee3f8f-685e-45c2-bb07-ae664449f16f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:46 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 Jun 01 09:36:46 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:46 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1" returned: 0 in 0.727s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:36:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[12379ec2-96a1-4da2-9966-5f74bb54e9dd]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:46 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 Jun 01 09:36:46 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:47 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9" returned: 0 in 0.807s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:47 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 Jun 01 09:36:47 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:48 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1" returned: 0 in 0.915s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:48 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1 Jun 01 09:36:48 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:49 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9.62b4812f-642c-497b-adc3-80c162ff74a1" returned: 0 in 0.713s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-62b4812f-642c-497b-adc3-80c162ff74a1" released by "_delete_snapshot" :: held 3.298s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-b0ce357f-de22-41de-bea0-77eb9ec1daf9" released by "delete_snapshot" :: held 3.330s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-cb710445-5074-4fc2-8936-d489970485e4" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-cb710445-5074-4fc2-8936-d489970485e4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-df9aed57-ae09-4463-a648-10ddef49d21c" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-df9aed57-ae09-4463-a648-10ddef49d21c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Deleting offline snapshot df9aed57-ae09-4463-a648-10ddef49d21c of volume cb710445-5074-4fc2-8936-d489970485e4 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] snapshot_file for this snap is: volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:36:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6fbcba-7c7e-44b0-b69c-1735ad26c297]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:49 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c Jun 01 09:36:49 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:50 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c" returned: 0 in 0.876s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb710445-5074-4fc2-8936-d489970485e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:36:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7657815b-fd51-417e-b038-0a1ba983fdc9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:50 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4 Jun 01 09:36:50 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:50 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4" returned: 0 in 0.773s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:51 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c Jun 01 09:36:51 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:51 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c" returned: 0 in 0.710s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:51 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c Jun 01 09:36:51 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:52 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4.df9aed57-ae09-4463-a648-10ddef49d21c" returned: 0 in 0.712s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-df9aed57-ae09-4463-a648-10ddef49d21c" released by "_delete_snapshot" :: held 3.170s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-cb710445-5074-4fc2-8936-d489970485e4" released by "delete_snapshot" :: held 3.198s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:52 devstack cinder-volume[86649]: WARNING cinder.quota [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1561538650 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1561538650, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:36:52 devstack cinder-volume[86649]: WARNING cinder.quota [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1561538650 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1561538650, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:36:52 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Created reservations ['47ef485f-3b9f-4cdb-82e6-a54d2ab1cd40', 'dde40dc4-1073-49d7-97b4-a1616c00902a', '7459f573-8433-4e77-8ffe-4ba05ed58da4', '9c9a4f06-da20-4494-8da8-c816d137b5d9'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:52 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] Created reservations ['ec464bcd-aa7e-432b-9fe3-718ab09991f4', '510f0ba4-f55a-40f2-b607-855ffb584578', '62f1d915-31ad-45de-9e71-03670b67ab38', '69e7ff8c-2d60-48a2-bfca-113d29b5ccb5'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b40f03ab-d4c5-4f7d-bd8c-98ff2fbc21d4 tempest-GroupSnapshotsTest-968639615 None] group_snapshot e11b671b-255b-4165-a376-cb71512ce295: deleted successfully Jun 01 09:36:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-b0ce357f-de22-41de-bea0-77eb9ec1daf9" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-b0ce357f-de22-41de-bea0-77eb9ec1daf9" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:53 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec631a6-99b9-4485-85f1-d6fdbfb8f7e6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:53 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 Jun 01 09:36:53 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:54 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9" returned: 0 in 1.113s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:55 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9 Jun 01 09:36:55 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:55 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b0ce357f-de22-41de-bea0-77eb9ec1daf9" returned: 0 in 0.744s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-b0ce357f-de22-41de-bea0-77eb9ec1daf9" released by "delete_volume" :: held 1.941s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-cb710445-5074-4fc2-8936-d489970485e4" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:36:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-cb710445-5074-4fc2-8936-d489970485e4" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:36:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c03bab-7358-4c3f-a923-b31965f09193]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:36:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:56 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4 Jun 01 09:36:56 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:57 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4" returned: 0 in 1.306s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:57 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4 Jun 01 09:36:57 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:58 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-cb710445-5074-4fc2-8936-d489970485e4" returned: 0 in 0.896s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-cb710445-5074-4fc2-8936-d489970485e4" released by "delete_volume" :: held 2.315s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:36:58 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=116,cinder:INSERT=34,cinder:UPDATE=110,cinder:DELETE=6 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:36:58 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Created reservations ['6cf1b33b-4b65-4b7b-baaf-8fa4cd450a36'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:58 devstack cinder-volume[86649]: WARNING cinder.quota [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1561538650 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1561538650, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:36:58 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Created reservations ['1f24cb16-6c0c-43e8-a46b-f42630b7215a', '541a6280-c3b5-410a-ac69-ba326e65d3f3', 'ffe8c058-c0d9-497a-87d2-623122fb0ecf', '321897b1-62ce-420b-8eb2-4586458e7c02'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:58 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Created reservations ['d7ed218c-3307-40f8-abf3-fa7fbfc75bd9', '19fdc176-2701-47e4-8ffc-b02762594a6f', 'ddfa57dc-edc4-416f-8dae-e3e7798423d7', 'a3e362eb-8021-4508-83bd-dd9a3494e43a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:36:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:36:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:36:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:36:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:36:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:36:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:36:58 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:36:58 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:36:59 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jun 01 09:36:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.878s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:36:59 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:36:59 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-36134c79-16a4-4e4b-a146-c8cd058d9d68 tempest-GroupSnapshotsTest-968639615 None] Delete group completed successfully. Jun 01 09:37:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-098af143-43ab-44a2-be5b-fa224371f989 tempest-GroupSnapshotsTest-968639615 None] Group tempest-GroupSnapshotsTest-Group-801747072: creating Jun 01 09:37:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-098af143-43ab-44a2-be5b-fa224371f989 tempest-GroupSnapshotsTest-968639615 None] Group tempest-GroupSnapshotsTest-Group-801747072: created successfully Jun 01 09:37:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-098af143-43ab-44a2-be5b-fa224371f989 tempest-GroupSnapshotsTest-968639615 None] Create group completed successfully. Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Flow 'volume_create_manager' (6bc7b335-bd57-4ec2-8acd-dbdfcd9c35fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ef8c75-dac3-490d-aa3c-c124d562976f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ef8c75-dac3-490d-aa3c-c124d562976f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-759582118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=177c724e-0726-4b78-ad45-701aed316384,host='devstack@QuobyteHD#QuobyteHD',id=71564ebf-3ddd-4ca5-9cb8-56003fd46ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d397ee81ed5045f28a617f1bb86ef93e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:37:02Z,use_quota=True,user_id='d44448a124b746d898c46fb005ebd36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1d8cf53-b2e8-475e-b5ed-6cb84dadac6e),volume_type_id=d1d8cf53-b2e8-475e-b5ed-6cb84dadac6e)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600e22a3-b43d-4456-ab46-c89d8e4b9aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600e22a3-b43d-4456-ab46-c89d8e4b9aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b4226f-37c3-46f2-8a6f-d0a99309b6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b4226f-37c3-46f2-8a6f-d0a99309b6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71564ebf-3ddd-4ca5-9cb8-56003fd46ba3', 'volume_name': 'volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572606f4-8ea5-4975-ac52-0480899f7483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572606f4-8ea5-4975-ac52-0480899f7483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388f070f-d339-4a18-ab8c-4c1377dd9f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:02 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Volume 71564ebf-3ddd-4ca5-9cb8-56003fd46ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3', 'volume_size': 1} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=177c724e-0726-4b78-ad45-701aed316384,created_at=2026-06-01T07:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-759582118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=177c724e-0726-4b78-ad45-701aed316384,host='devstack@QuobyteHD#QuobyteHD',id=71564ebf-3ddd-4ca5-9cb8-56003fd46ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d397ee81ed5045f28a617f1bb86ef93e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:37:02Z,use_quota=True,user_id='d44448a124b746d898c46fb005ebd36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1d8cf53-b2e8-475e-b5ed-6cb84dadac6e),volume_type_id=d1d8cf53-b2e8-475e-b5ed-6cb84dadac6e)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Creating volume 71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:37:02 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:37:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:02 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 1073741824 Jun 01 09:37:02 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:03 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 1073741824" returned: 0 in 0.937s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:03 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 Jun 01 09:37:03 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:03 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3" returned: 0 in 0.653s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:37:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388f070f-d339-4a18-ab8c-4c1377dd9f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a5395e6-6e89-4a6f-8029-ff9acf9d2263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:03 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Volume volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 (71564ebf-3ddd-4ca5-9cb8-56003fd46ba3): created successfully Jun 01 09:37:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a5395e6-6e89-4a6f-8029-ff9acf9d2263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Flow 'volume_create_manager' (6bc7b335-bd57-4ec2-8acd-dbdfcd9c35fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:37:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f11d1ead-daf2-4ee0-856e-e7990a7a1565 tempest-GroupSnapshotsTest-968639615 None] Created volume successfully. Jun 01 09:37:04 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] GroupSnapshot 45491ebd-72cd-4b98-a3f1-a5e3e94dbec1: creating. Jun 01 09:37:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] Group snapshot 45491ebd-72cd-4b98-a3f1-a5e3e94dbec1: creating. {{(pid=86649) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 01 09:37:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] Creating offline snapshot b59a7bd3-21c2-44e3-9fb3-50e0fad296fc of volume 71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:37:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[849cb3c5-3ff4-46cd-9c48-85a19e1b4a22]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:37:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:04 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 Jun 01 09:37:04 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:05 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3" returned: 0 in 0.943s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:05 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc 1G Jun 01 09:37:05 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:06 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc 1G" returned: 0 in 0.901s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:06 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc Jun 01 09:37:06 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:07 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc" returned: 0 in 0.730s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:07 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc is being set with open permissions: ugo+rw: NotImplementedError Jun 01 09:37:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:07 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc Jun 01 09:37:07 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:07 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc" returned: 0 in 0.654s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:07 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.info Jun 01 09:37:07 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:08 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.info" returned: 0 in 0.801s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:08 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.info is being set with open permissions: ugo+rw: NotImplementedError Jun 01 09:37:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:08 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.info Jun 01 09:37:08 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:09 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.info" returned: 0 in 0.617s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.748s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-285c3cf3-26e1-4460-8851-0afe35d3b099 tempest-GroupSnapshotsTest-968639615 None] group_snapshot 45491ebd-72cd-4b98-a3f1-a5e3e94dbec1: created successfully Jun 01 09:37:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] group_snapshot 45491ebd-72cd-4b98-a3f1-a5e3e94dbec1: deleting Jun 01 09:37:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] group_snapshot 45491ebd-72cd-4b98-a3f1-a5e3e94dbec1: deleting {{(pid=86649) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 01 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-b59a7bd3-21c2-44e3-9fb3-50e0fad296fc" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-b59a7bd3-21c2-44e3-9fb3-50e0fad296fc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Deleting offline snapshot b59a7bd3-21c2-44e3-9fb3-50e0fad296fc of volume 71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] snapshot_file for this snap is: volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:37:10 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f08840-9c10-4859-8e09-af3a77520b6c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:37:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:10 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc Jun 01 09:37:10 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:10 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc" returned: 0 in 0.801s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:37:10 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6493ff5-952e-4fff-b80a-0715d48651bc]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:37:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:11 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 Jun 01 09:37:11 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:11 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3" returned: 0 in 0.744s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:11 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc Jun 01 09:37:11 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:12 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc" returned: 0 in 0.722s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:12 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc Jun 01 09:37:12 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:13 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3.b59a7bd3-21c2-44e3-9fb3-50e0fad296fc" returned: 0 in 0.601s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-b59a7bd3-21c2-44e3-9fb3-50e0fad296fc" released by "_delete_snapshot" :: held 2.976s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:37:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3" released by "delete_snapshot" :: held 2.998s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:37:13 devstack cinder-volume[86649]: WARNING cinder.quota [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-228995772 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-228995772, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:37:13 devstack cinder-volume[86649]: WARNING cinder.quota [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-228995772 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-228995772, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:37:13 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] Created reservations ['4b1d48c6-12d0-496f-9d61-dd092f989450', '0582ffd8-88d9-4ed1-85fa-8780defa2a1d', 'caf052cb-382f-4009-b6ae-5a02dfc9398a', '33304140-0d79-44e5-b9bf-b813177fec26'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:37:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f0736006-f24f-4983-8203-7aaadf5198a3 tempest-GroupSnapshotsTest-968639615 None] group_snapshot 45491ebd-72cd-4b98-a3f1-a5e3e94dbec1: deleted successfully Jun 01 09:37:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "cinder-quobyte-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:37:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:37:13 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbb4f1f-b24a-4a9e-bf78-6920f6c598e1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:37:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:13 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 Jun 01 09:37:13 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:14 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3" returned: 0 in 0.746s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:14 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3 Jun 01 09:37:14 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:14 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3" returned: 0 in 0.605s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Lock "cinder-quobyte-71564ebf-3ddd-4ca5-9cb8-56003fd46ba3" released by "delete_volume" :: held 1.431s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:37:15 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Created reservations ['ab605ffb-d4b3-4ccb-af80-58d7b4118bfa'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:37:15 devstack cinder-volume[86649]: WARNING cinder.quota [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-228995772 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-228995772, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:37:15 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Created reservations ['77b2e6e9-f809-4e30-b9c9-ef1375101291', '73521283-2ac3-4b13-928b-51d213feebd0', '91d6455e-fccf-47da-bcc5-bfb3e6a06bb6', '351f753f-b875-4113-a880-1665cea7f70f'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:37:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:37:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:37:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:15 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:37:15 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:15 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.628s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:15 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:37:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-21a2b7f2-6e06-44a0-b3e7-4185083970f6 tempest-GroupSnapshotsTest-968639615 None] Delete group completed successfully. Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Flow 'volume_create_manager' (5a5f7433-8d79-46e1-9725-05259652a056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca25aae5-8b50-4779-8134-d164290706d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca25aae5-8b50-4779-8134-d164290706d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-487551353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95edc71b7d5545dd9dfe66003ad99a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:37:21Z,use_quota=True,user_id='4556f162e5ee4c4280099d79ffb03334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57249c8c-c488-47a2-8042-616c9102fb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57249c8c-c488-47a2-8042-616c9102fb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497a7e59-28d3-425a-81bf-bf9f1734e960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497a7e59-28d3-425a-81bf-bf9f1734e960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf', 'volume_name': 'volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f994fe0-5645-48e2-9eea-8f2a33a50843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f994fe0-5645-48e2-9eea-8f2a33a50843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3822f631-dc57-4455-b1e8-b2297eaf7afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:21 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Volume 6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf', 'volume_size': 1} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-487551353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95edc71b7d5545dd9dfe66003ad99a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:37:21Z,use_quota=True,user_id='4556f162e5ee4c4280099d79ffb03334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Creating volume 6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:37:21 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:37:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:21 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf 1073741824 Jun 01 09:37:21 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:22 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf 1073741824" returned: 0 in 0.911s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:22 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf Jun 01 09:37:22 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:23 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf" returned: 0 in 0.675s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:37:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3822f631-dc57-4455-b1e8-b2297eaf7afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac95be87-81a8-41a1-a7a1-8b4f94a4d03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:23 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Volume volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf (6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf): created successfully Jun 01 09:37:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac95be87-81a8-41a1-a7a1-8b4f94a4d03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Flow 'volume_create_manager' (5a5f7433-8d79-46e1-9725-05259652a056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:37:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3ac8d065-c089-4f8c-be21-72d7459037ef tempest-AttachVolumeNegativeTest-312487544 None] Created volume successfully. Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Flow 'volume_create_manager' (dba0daa2-bc70-4d9b-b0de-d9d20ea180c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120b42b2-0a8c-47bd-bce5-443af6d58a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120b42b2-0a8c-47bd-bce5-443af6d58a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1603561505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04f039f-3021-46e7-8f57-d6ce0e3f5232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16729afbf59451a922abffa2902761b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:37:26Z,use_quota=True,user_id='bf65174726264ccc8146f951c7e38e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a39bf6-6935-4231-ae1c-a02778630956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a39bf6-6935-4231-ae1c-a02778630956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9233d9a4-f42c-4712-9b42-9660dba42131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9233d9a4-f42c-4712-9b42-9660dba42131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a04f039f-3021-46e7-8f57-d6ce0e3f5232', 'volume_name': 'volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb7f977-f0af-4f1f-add9-d4e3b788af5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb7f977-f0af-4f1f-add9-d4e3b788af5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d369d8c-f74a-4efe-a334-5a86d3b0fe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:25 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Volume a04f039f-3021-46e7-8f57-d6ce0e3f5232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232', 'volume_size': 1} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1603561505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04f039f-3021-46e7-8f57-d6ce0e3f5232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16729afbf59451a922abffa2902761b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:37:26Z,use_quota=True,user_id='bf65174726264ccc8146f951c7e38e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Creating volume a04f039f-3021-46e7-8f57-d6ce0e3f5232 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:37:25 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:37:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:25 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232 1073741824 Jun 01 09:37:25 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-4dd70db1-e6f7-436d-838c-c9e811bf0559 req-9195e474-3262-45a3-94eb-7b0d563b66e1 tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:27 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232 1073741824" returned: 0 in 1.338s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:27 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232 Jun 01 09:37:27 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:27 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232" returned: 0 in 0.608s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:37:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-4dd70db1-e6f7-436d-838c-c9e811bf0559 req-9195e474-3262-45a3-94eb-7b0d563b66e1 tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.897s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d369d8c-f74a-4efe-a334-5a86d3b0fe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c66f762-7ad8-4d48-91c6-a556579c52d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:27 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e8f54d-ae4c-4e6c-9207-e79872dc071b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:37:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-4dd70db1-e6f7-436d-838c-c9e811bf0559 req-9195e474-3262-45a3-94eb-7b0d563b66e1 tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:27 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Volume volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232 (a04f039f-3021-46e7-8f57-d6ce0e3f5232): created successfully Jun 01 09:37:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c66f762-7ad8-4d48-91c6-a556579c52d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Flow 'volume_create_manager' (dba0daa2-bc70-4d9b-b0de-d9d20ea180c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:37:27 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-61972963-6619-4b5a-a05b-4033ffca2380 tempest-VolumeQuotasNegativeTestJSON-523907372 None] Created volume successfully. Jun 01 09:37:28 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf Jun 01 09:37:28 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:28 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-4dd70db1-e6f7-436d-838c-c9e811bf0559 req-9195e474-3262-45a3-94eb-7b0d563b66e1 tempest-AttachVolumeNegativeTest-312487544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf" returned: 0 in 0.899s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-4dd70db1-e6f7-436d-838c-c9e811bf0559 req-9195e474-3262-45a3-94eb-7b0d563b66e1 tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.943s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-4dd70db1-e6f7-436d-838c-c9e811bf0559 req-9195e474-3262-45a3-94eb-7b0d563b66e1 tempest-AttachVolumeNegativeTest-312487544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0518ea0c-5101-4824-b76e-1f2aba6d5f25', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:37:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-4dd70db1-e6f7-436d-838c-c9e811bf0559 req-9195e474-3262-45a3-94eb-7b0d563b66e1 tempest-AttachVolumeNegativeTest-312487544 None] attachment_update completed successfully. Jun 01 09:37:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Acquiring lock "cinder-a04f039f-3021-46e7-8f57-d6ce0e3f5232-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:37:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Lock "cinder-a04f039f-3021-46e7-8f57-d6ce0e3f5232-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:37:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Acquiring lock "cinder-quobyte-a04f039f-3021-46e7-8f57-d6ce0e3f5232" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:37:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Lock "cinder-quobyte-a04f039f-3021-46e7-8f57-d6ce0e3f5232" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:37:30 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d263a3c3-2879-4126-8a83-d4cc8fa28f01]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:37:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:30 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232 Jun 01 09:37:30 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:30 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232" returned: 0 in 0.752s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:31 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232 Jun 01 09:37:31 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:31 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a04f039f-3021-46e7-8f57-d6ce0e3f5232" returned: 0 in 0.635s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Lock "cinder-quobyte-a04f039f-3021-46e7-8f57-d6ce0e3f5232" released by "delete_volume" :: held 1.437s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:37:31 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Created reservations ['4bd5805c-e9f6-40a3-945f-7461a29e12a8', '664d274a-6739-4ca7-bce5-a6a958c45a58', 'a67045fb-a699-48bc-9ecf-4ac197d36b6b', '1e1e686a-d216-4c25-b4d3-ecaed104d79b'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:37:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:37:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:37:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:31 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:37:31 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:32 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.706s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:32 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:37:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Deleted volume successfully. Jun 01 09:37:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80883588-ad41-4882-9b18-0d0e8bd067db tempest-VolumeQuotasNegativeTestJSON-523907372 None] Lock "cinder-a04f039f-3021-46e7-8f57-d6ce0e3f5232-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:37:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:37:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:37:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:37:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:36 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:37:36 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:37 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.781s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Flow 'volume_create_manager' (5952f6d9-d7c9-4cb2-88bb-b31bbd54425c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a683962-3a2f-42c2-bbd5-1428469de1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a683962-3a2f-42c2-bbd5-1428469de1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-517533890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6ec56c9-9ca5-42ec-9e89-902623c48c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a0fb2afe43e44b7b825bcae48ce5ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:37:39Z,use_quota=True,user_id='943aaa9af516424bbc6567e0da3e89b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e143a1ac-dac3-48be-a850-1eb74ed5001e),volume_type_id=e143a1ac-dac3-48be-a850-1eb74ed5001e)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5cf2cc8-72c0-4630-82c1-30d3d295af87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5cf2cc8-72c0-4630-82c1-30d3d295af87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ae56e8-c206-47db-a1ef-433d502f1477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ae56e8-c206-47db-a1ef-433d502f1477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6ec56c9-9ca5-42ec-9e89-902623c48c8e', 'volume_name': 'volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d88918-8bba-41f2-9ae0-5f536fd2d346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d88918-8bba-41f2-9ae0-5f536fd2d346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b699953-b981-4fbe-94d7-8560392e6d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:38 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Volume d6ec56c9-9ca5-42ec-9e89-902623c48c8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e', 'volume_size': 1} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-517533890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6ec56c9-9ca5-42ec-9e89-902623c48c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a0fb2afe43e44b7b825bcae48ce5ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:37:39Z,use_quota=True,user_id='943aaa9af516424bbc6567e0da3e89b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e143a1ac-dac3-48be-a850-1eb74ed5001e),volume_type_id=e143a1ac-dac3-48be-a850-1eb74ed5001e)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Creating volume d6ec56c9-9ca5-42ec-9e89-902623c48c8e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:37:38 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:37:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:38 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e 1073741824 Jun 01 09:37:38 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:39 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e 1073741824" returned: 0 in 0.849s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:39 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e Jun 01 09:37:39 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:40 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e" returned: 0 in 0.589s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:37:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b699953-b981-4fbe-94d7-8560392e6d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb4b07c-5ffc-4651-a66a-7fe0d689d684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:40 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Volume volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e (d6ec56c9-9ca5-42ec-9e89-902623c48c8e): created successfully Jun 01 09:37:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb4b07c-5ffc-4651-a66a-7fe0d689d684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Flow 'volume_create_manager' (5952f6d9-d7c9-4cb2-88bb-b31bbd54425c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:37:40 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d3e9586d-db92-4f71-ae64-dd56ed8354b2 tempest-VolumeTypesAccessTest-694984211 None] Created volume successfully. Jun 01 09:37:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Acquiring lock "cinder-d6ec56c9-9ca5-42ec-9e89-902623c48c8e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:37:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Lock "cinder-d6ec56c9-9ca5-42ec-9e89-902623c48c8e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:37:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Acquiring lock "cinder-quobyte-d6ec56c9-9ca5-42ec-9e89-902623c48c8e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:37:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Lock "cinder-quobyte-d6ec56c9-9ca5-42ec-9e89-902623c48c8e" acquired by "delete_volume" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:37:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a477ac13-c2e1-4b2e-8f04-50d95750ca3b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:37:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:41 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e Jun 01 09:37:41 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:41 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e" returned: 0 in 0.745s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:41 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e Jun 01 09:37:41 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:42 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d6ec56c9-9ca5-42ec-9e89-902623c48c8e" returned: 0 in 0.633s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Lock "cinder-quobyte-d6ec56c9-9ca5-42ec-9e89-902623c48c8e" released by "delete_volume" :: held 1.428s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:37:42 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:INSERT=22,cinder:UPDATE=89,cinder:SELECT=79,cinder:DELETE=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:37:42 devstack cinder-volume[86649]: WARNING cinder.quota [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1079814314 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1079814314, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:37:42 devstack cinder-volume[86649]: WARNING cinder.quota [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1079814314 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1079814314, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:37:42 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Created reservations ['e6ec8df8-13f7-46ac-bd97-b5c0fedebc53', 'bd584afb-b2c4-475d-b5c5-b61d1f32867e', '35fb0bd8-ceb8-4534-a9f2-038ce988287a', 'a3c7427f-1276-46c3-8d6f-2d49cd094abc'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:37:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:37:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:37:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:42 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:37:42 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:43 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.683s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:43 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:37:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Deleted volume successfully. Jun 01 09:37:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f7c1b67b-5c21-4eee-bd2c-da986157cf09 tempest-VolumeTypesAccessTest-694984211 None] Lock "cinder-d6ec56c9-9ca5-42ec-9e89-902623c48c8e-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Flow 'volume_create_manager' (80d82473-0cc8-4902-8475-dee53710355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb86de26-5f16-4166-b4b5-be3c914e421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb86de26-5f16-4166-b4b5-be3c914e421f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-232239716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64afe513-111a-4031-9d81-62fb3743f2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18985d3e3ca04556a4de8e4e2676f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:37:52Z,use_quota=True,user_id='3ac3c28999524b68b8158e35960f0ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec400436-cd99-4415-85ec-6d9bd86fb6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec400436-cd99-4415-85ec-6d9bd86fb6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fe1143-3696-4379-8fae-9adb13884cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fe1143-3696-4379-8fae-9adb13884cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64afe513-111a-4031-9d81-62fb3743f2fe', 'volume_name': 'volume-64afe513-111a-4031-9d81-62fb3743f2fe', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e83a6fca-a8ea-43f9-a8d2-4574b3f3611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e83a6fca-a8ea-43f9-a8d2-4574b3f3611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17fc43a-cbc7-42c8-b09e-ba2afbb79539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:52 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Volume 64afe513-111a-4031-9d81-62fb3743f2fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64afe513-111a-4031-9d81-62fb3743f2fe', 'volume_size': 1} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-232239716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64afe513-111a-4031-9d81-62fb3743f2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18985d3e3ca04556a4de8e4e2676f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:37:52Z,use_quota=True,user_id='3ac3c28999524b68b8158e35960f0ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Creating volume 64afe513-111a-4031-9d81-62fb3743f2fe {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:37:52 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:37:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:52 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe 1073741824 Jun 01 09:37:52 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:53 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe 1073741824" returned: 0 in 1.270s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:53 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe Jun 01 09:37:53 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:54 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe" returned: 0 in 0.830s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:37:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17fc43a-cbc7-42c8-b09e-ba2afbb79539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64afe513-111a-4031-9d81-62fb3743f2fe', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f13f3e-a3a5-421a-bad8-1878729e3044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:37:54 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Volume volume-64afe513-111a-4031-9d81-62fb3743f2fe (64afe513-111a-4031-9d81-62fb3743f2fe): created successfully Jun 01 09:37:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f13f3e-a3a5-421a-bad8-1878729e3044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:37:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Flow 'volume_create_manager' (80d82473-0cc8-4902-8475-dee53710355d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:37:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8586b301-8d66-477b-a769-c0dc60a64e62 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Created volume successfully. Jun 01 09:37:58 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=67,cinder:INSERT=13,cinder:UPDATE=72,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:37:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-8c8775ff-073c-403b-86f3-fb207cbe03b1 req-04a7e438-c6b5-4181-b033-583c8eb43896 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:37:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-8c8775ff-073c-403b-86f3-fb207cbe03b1 req-04a7e438-c6b5-4181-b033-583c8eb43896 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:37:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bd70c0-5088-4815-b1d1-1d1685e38599]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:37:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-8c8775ff-073c-403b-86f3-fb207cbe03b1 req-04a7e438-c6b5-4181-b033-583c8eb43896 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:37:59 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe Jun 01 09:37:59 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:37:59 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Jun 01 09:37:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-8c8775ff-073c-403b-86f3-fb207cbe03b1 req-04a7e438-c6b5-4181-b033-583c8eb43896 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe" returned: 0 in 0.866s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:37:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-8c8775ff-073c-403b-86f3-fb207cbe03b1 req-04a7e438-c6b5-4181-b033-583c8eb43896 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.897s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:37:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-8c8775ff-073c-403b-86f3-fb207cbe03b1 req-04a7e438-c6b5-4181-b033-583c8eb43896 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-64afe513-111a-4031-9d81-62fb3743f2fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38c8eb5c-f351-4f25-badc-7736cf2df5d9', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:38:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-8c8775ff-073c-403b-86f3-fb207cbe03b1 req-04a7e438-c6b5-4181-b033-583c8eb43896 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] attachment_update completed successfully. Jun 01 09:38:07 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-7413d13e-5eb3-495a-8f1f-1b7663beee5d req-07c3fb50-5c02-4bce-8070-95a2c329abef tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Terminate volume connection completed successfully. Jun 01 09:38:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-7413d13e-5eb3-495a-8f1f-1b7663beee5d req-07c3fb50-5c02-4bce-8070-95a2c329abef tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Deleting attachment 38c8eb5c-f351-4f25-badc-7736cf2df5d9. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:38:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Acquiring lock "cinder-64afe513-111a-4031-9d81-62fb3743f2fe-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Lock "cinder-64afe513-111a-4031-9d81-62fb3743f2fe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Acquiring lock "cinder-quobyte-64afe513-111a-4031-9d81-62fb3743f2fe" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Lock "cinder-quobyte-64afe513-111a-4031-9d81-62fb3743f2fe" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5aae5c-b048-4200-840f-41cc4ea073fd]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:38:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:09 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe Jun 01 09:38:09 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:10 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe" returned: 0 in 0.805s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:10 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe Jun 01 09:38:10 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:11 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64afe513-111a-4031-9d81-62fb3743f2fe" returned: 0 in 0.631s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Lock "cinder-quobyte-64afe513-111a-4031-9d81-62fb3743f2fe" released by "delete_volume" :: held 1.496s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:11 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Created reservations ['09c39f95-0de2-46ec-9483-8768255db908', '2b26ab7c-1300-4474-82a0-c0a4c1cdd56b', 'ef1fb96a-e3e4-4bd0-8d47-5fb7c2d9b687', '8417b6d0-de0f-499e-9759-438fcc383b2c'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:38:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:38:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:38:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:11 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:38:11 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:12 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.613s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:12 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:38:12 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Deleted volume successfully. Jun 01 09:38:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1bb7f05a-8137-45bb-99df-8104a4886594 tempest-TestServerVolumeAttachScenarioOldVersion-1405869991 None] Lock "cinder-64afe513-111a-4031-9d81-62fb3743f2fe-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-829c58c5-7188-4f9f-91b4-a00068e6f585 req-7bbcf067-0794-4a54-b98f-6e4c57f496d7 tempest-AttachVolumeNegativeTest-312487544 None] Terminate volume connection completed successfully. Jun 01 09:38:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-829c58c5-7188-4f9f-91b4-a00068e6f585 req-7bbcf067-0794-4a54-b98f-6e4c57f496d7 tempest-AttachVolumeNegativeTest-312487544 None] Deleting attachment 0518ea0c-5101-4824-b76e-1f2aba6d5f25. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Flow 'volume_create_manager' (9a24620c-76dd-4b97-b332-8c29c9c90d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f595f094-7f8f-4d96-9ff9-2fe74963b0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f595f094-7f8f-4d96-9ff9-2fe74963b0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-155896947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58dd2482-0e83-4ec1-8248-317446311537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4aa6a2524d4d03b29b7ddfc8782ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:38:26Z,use_quota=True,user_id='39aa572500044906952a42df04f97628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498443ca-e7c0-4959-b805-50baa81f6594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498443ca-e7c0-4959-b805-50baa81f6594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e50c9bf8-8cab-4b46-83f4-e8a565864655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e50c9bf8-8cab-4b46-83f4-e8a565864655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58dd2482-0e83-4ec1-8248-317446311537', 'volume_name': 'volume-58dd2482-0e83-4ec1-8248-317446311537', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad802bb3-9a4a-4bff-b21c-c5416c4dab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad802bb3-9a4a-4bff-b21c-c5416c4dab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b8e3f2c-57ba-463a-a29d-29020e65391a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:26 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Volume 58dd2482-0e83-4ec1-8248-317446311537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58dd2482-0e83-4ec1-8248-317446311537', 'volume_size': 1} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-155896947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58dd2482-0e83-4ec1-8248-317446311537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4aa6a2524d4d03b29b7ddfc8782ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:38:26Z,use_quota=True,user_id='39aa572500044906952a42df04f97628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Creating volume 58dd2482-0e83-4ec1-8248-317446311537 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:38:26 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:38:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-58dd2482-0e83-4ec1-8248-317446311537 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:26 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-58dd2482-0e83-4ec1-8248-317446311537 1073741824 Jun 01 09:38:26 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:27 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-58dd2482-0e83-4ec1-8248-317446311537 1073741824" returned: 0 in 1.173s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-58dd2482-0e83-4ec1-8248-317446311537 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:27 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-58dd2482-0e83-4ec1-8248-317446311537 Jun 01 09:38:27 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:28 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-58dd2482-0e83-4ec1-8248-317446311537" returned: 0 in 0.660s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:38:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b8e3f2c-57ba-463a-a29d-29020e65391a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58dd2482-0e83-4ec1-8248-317446311537', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b224c62-5521-420f-9783-c29970e97924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Volume volume-58dd2482-0e83-4ec1-8248-317446311537 (58dd2482-0e83-4ec1-8248-317446311537): created successfully Jun 01 09:38:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b224c62-5521-420f-9783-c29970e97924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Flow 'volume_create_manager' (9a24620c-76dd-4b97-b332-8c29c9c90d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:38:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0e0fa43d-5dbe-4c56-b202-72714346186a tempest-VolumesActionsTest-175257372 None] Created volume successfully. Jun 01 09:38:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3434506c-003b-4ee3-86f7-ae911c19192b tempest-VolumesActionsTest-175257372 None] Acquiring lock "cinder-58dd2482-0e83-4ec1-8248-317446311537" by "attach_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3434506c-003b-4ee3-86f7-ae911c19192b tempest-VolumesActionsTest-175257372 None] Lock "cinder-58dd2482-0e83-4ec1-8248-317446311537" acquired by "attach_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3434506c-003b-4ee3-86f7-ae911c19192b tempest-VolumesActionsTest-175257372 None] Attaching volume 58dd2482-0e83-4ec1-8248-317446311537 to instance 38000404-9ca7-462c-a538-2e951774a263 at mountpoint /dev/vdb on host None. Jun 01 09:38:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3434506c-003b-4ee3-86f7-ae911c19192b tempest-VolumesActionsTest-175257372 None] Attach volume completed successfully. Jun 01 09:38:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3434506c-003b-4ee3-86f7-ae911c19192b tempest-VolumesActionsTest-175257372 None] Lock "cinder-58dd2482-0e83-4ec1-8248-317446311537" released by "attach_volume" :: held 0.117s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-22f51dce-9a8c-43ad-80c2-2bb150d9e78b tempest-VolumesActionsTest-1581729882 None] Terminate volume connection completed successfully. Jun 01 09:38:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-22f51dce-9a8c-43ad-80c2-2bb150d9e78b tempest-VolumesActionsTest-1581729882 None] Acquiring lock "cinder-58dd2482-0e83-4ec1-8248-317446311537-detach_volume" by "detach_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-22f51dce-9a8c-43ad-80c2-2bb150d9e78b tempest-VolumesActionsTest-1581729882 None] Lock "cinder-58dd2482-0e83-4ec1-8248-317446311537-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-22f51dce-9a8c-43ad-80c2-2bb150d9e78b tempest-VolumesActionsTest-1581729882 None] Detaching volume 58dd2482-0e83-4ec1-8248-317446311537 from instance 38000404-9ca7-462c-a538-2e951774a263. Jun 01 09:38:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-22f51dce-9a8c-43ad-80c2-2bb150d9e78b tempest-VolumesActionsTest-1581729882 None] Detach volume completed successfully. Jun 01 09:38:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-22f51dce-9a8c-43ad-80c2-2bb150d9e78b tempest-VolumesActionsTest-1581729882 None] Lock "cinder-58dd2482-0e83-4ec1-8248-317446311537-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8ec951c2-f241-46a0-9672-1d4c6118cb10 tempest-VolumesActionsTest-175257372 None] Acquiring lock "cinder-58dd2482-0e83-4ec1-8248-317446311537-detach_volume" by "detach_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8ec951c2-f241-46a0-9672-1d4c6118cb10 tempest-VolumesActionsTest-175257372 None] Lock "cinder-58dd2482-0e83-4ec1-8248-317446311537-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8ec951c2-f241-46a0-9672-1d4c6118cb10 tempest-VolumesActionsTest-175257372 None] Volume detach called, but volume not attached. Jun 01 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8ec951c2-f241-46a0-9672-1d4c6118cb10 tempest-VolumesActionsTest-175257372 None] Lock "cinder-58dd2482-0e83-4ec1-8248-317446311537-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Acquiring lock "cinder-58dd2482-0e83-4ec1-8248-317446311537-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Lock "cinder-58dd2482-0e83-4ec1-8248-317446311537-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Acquiring lock "cinder-quobyte-58dd2482-0e83-4ec1-8248-317446311537" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Lock "cinder-quobyte-58dd2482-0e83-4ec1-8248-317446311537" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[297f6617-508c-4109-b474-c07c29e8b367]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:38:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-58dd2482-0e83-4ec1-8248-317446311537 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:32 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-58dd2482-0e83-4ec1-8248-317446311537 Jun 01 09:38:32 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:33 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-58dd2482-0e83-4ec1-8248-317446311537" returned: 0 in 0.795s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-58dd2482-0e83-4ec1-8248-317446311537 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:33 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-58dd2482-0e83-4ec1-8248-317446311537 Jun 01 09:38:33 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:34 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-58dd2482-0e83-4ec1-8248-317446311537" returned: 0 in 0.757s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Lock "cinder-quobyte-58dd2482-0e83-4ec1-8248-317446311537" released by "delete_volume" :: held 1.608s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Created reservations ['0b97b5bf-2e54-411f-b95d-8593fc9f4b7d', '786c6289-ef42-4087-bead-0e2b93af37cf', 'e726d168-c7cd-42cd-857e-0fd766ee169f', '9981f1c9-e8e2-48e1-a145-2448142d8452'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:38:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:38:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:34 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:38:34 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:35 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.913s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:38:35 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Deleted volume successfully. Jun 01 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-969b966e-ad83-434f-9f3f-978d20e544dc tempest-VolumesActionsTest-175257372 None] Lock "cinder-58dd2482-0e83-4ec1-8248-317446311537-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:38:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:36 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:38:36 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:37 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.825s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Flow 'volume_create_manager' (6f1f193c-35ba-4dc1-9f3b-b189640cba53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01dd27e2-c229-4d7b-8578-c0eb197f3028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01dd27e2-c229-4d7b-8578-c0eb197f3028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd14c7e-6e5c-4e73-a12e-3df49d0286f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ae312de45946e7a813504856f3bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:38:38Z,use_quota=True,user_id='254478d4d48144bc85df9bedeb8fca18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(565fbd43-1301-469a-b9d4-96c251cba4ed),volume_type_id=565fbd43-1301-469a-b9d4-96c251cba4ed)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f789d91c-a23d-4fab-8fc6-6c9c224def82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f789d91c-a23d-4fab-8fc6-6c9c224def82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc1e613-4631-4efa-9cfb-5d9ccfb31876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc1e613-4631-4efa-9cfb-5d9ccfb31876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9fd14c7e-6e5c-4e73-a12e-3df49d0286f9', 'volume_name': 'volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9', 'volume_size': 1, 'image_id': 'ead4a640-2d85-4f8b-b035-f4d230f3163d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ead4a640-2d85-4f8b-b035-f4d230f3163d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce4441867c2d192113802c0fbbacd460', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49ae312de45946e7a813504856f3bb7c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d657c3a984d04e23b6e99b803909dd82227e6855e03755e1760e6dbe6b23f7a066ded7976fe5577e9f18553e7dca97695ee3f0fc886029c388ac46411f6ceec', 'id': 'ead4a640-2d85-4f8b-b035-f4d230f3163d', 'created_at': datetime.datetime(2026, 6, 1, 7, 38, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 38, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ead4a640-2d85-4f8b-b035-f4d230f3163d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6bc83f-f23c-4d8c-8d02-68c35e4d9980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6bc83f-f23c-4d8c-8d02-68c35e4d9980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971ad755-c527-4673-9162-bc3dfd7d20ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:38 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Volume 9fd14c7e-6e5c-4e73-a12e-3df49d0286f9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9', 'volume_size': 1, 'image_id': 'ead4a640-2d85-4f8b-b035-f4d230f3163d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ead4a640-2d85-4f8b-b035-f4d230f3163d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce4441867c2d192113802c0fbbacd460', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49ae312de45946e7a813504856f3bb7c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d657c3a984d04e23b6e99b803909dd82227e6855e03755e1760e6dbe6b23f7a066ded7976fe5577e9f18553e7dca97695ee3f0fc886029c388ac46411f6ceec', 'id': 'ead4a640-2d85-4f8b-b035-f4d230f3163d', 'created_at': datetime.datetime(2026, 6, 1, 7, 38, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 38, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ead4a640-2d85-4f8b-b035-f4d230f3163d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Trying to clone 9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 from image ead4a640-2d85-4f8b-b035-f4d230f3163d at location (None, [{'url': 'file:///opt/stack/data/glance/images/ead4a640-2d85-4f8b-b035-f4d230f3163d', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 01 09:38:38 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Image download 0.00 MB at 0.00 MB/s Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d090041-455f-4aff-8fb9-b4b775d47ac3]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:38:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:39 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD Jun 01 09:38:39 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:39 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD" returned: 0 in 0.695s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:39 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD Jun 01 09:38:39 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:40 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD" returned: 1 in 0.674s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:38:40 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Temporary image ead4a640-2d85-4f8b-b035-f4d230f3163d is fetched for user 254478d4d48144bc85df9bedeb8fca18. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 01 09:38:40 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[897e0217-7da9-4f0a-900e-7c14f4ee5543]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:38:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:40 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD Jun 01 09:38:40 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:41 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD" returned: 0 in 0.685s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:41 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD Jun 01 09:38:41 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:41 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD" returned: 1 in 0.670s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd14c7e-6e5c-4e73-a12e-3df49d0286f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ae312de45946e7a813504856f3bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:38:38Z,use_quota=True,user_id='254478d4d48144bc85df9bedeb8fca18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(565fbd43-1301-469a-b9d4-96c251cba4ed),volume_type_id=565fbd43-1301-469a-b9d4-96c251cba4ed)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Creating volume 9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:38:41 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:41 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 1073741824 Jun 01 09:38:41 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Flow 'volume_create_manager' (3764aaf3-51b0-4258-ba1c-f29177c824d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd7ccdd-b3da-4d64-9ab5-98644c280c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd7ccdd-b3da-4d64-9ab5-98644c280c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-493554865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf2113d-875e-4150-ac3b-d4d2782220e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4aa6a2524d4d03b29b7ddfc8782ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:38:42Z,use_quota=True,user_id='39aa572500044906952a42df04f97628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193afc5c-1241-404e-8fb1-1eff9ba58a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193afc5c-1241-404e-8fb1-1eff9ba58a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546c1f75-b7c6-4762-b315-5eb58e1d21a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546c1f75-b7c6-4762-b315-5eb58e1d21a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf2113d-875e-4150-ac3b-d4d2782220e1', 'volume_name': 'volume-1cf2113d-875e-4150-ac3b-d4d2782220e1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3854cb-2de9-461b-b3ca-7329683ece11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3854cb-2de9-461b-b3ca-7329683ece11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223a720a-be11-41b3-968d-0629878fdf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:42 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Volume 1cf2113d-875e-4150-ac3b-d4d2782220e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf2113d-875e-4150-ac3b-d4d2782220e1', 'volume_size': 1} Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:42 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 1073741824" returned: 0 in 0.815s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=34,cinder:INSERT=9,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:38:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:42 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 Jun 01 09:38:42 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:43 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9" returned: 0 in 0.603s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-493554865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf2113d-875e-4150-ac3b-d4d2782220e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4aa6a2524d4d03b29b7ddfc8782ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:38:42Z,use_quota=True,user_id='39aa572500044906952a42df04f97628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Creating volume 1cf2113d-875e-4150-ac3b-d4d2782220e1 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:38:43 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1cf2113d-875e-4150-ac3b-d4d2782220e1 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:43 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1cf2113d-875e-4150-ac3b-d4d2782220e1 1073741824 Jun 01 09:38:43 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Attempting download of ead4a640-2d85-4f8b-b035-f4d230f3163d ((None, [{'url': 'file:///opt/stack/data/glance/images/ead4a640-2d85-4f8b-b035-f4d230f3163d', 'metadata': {}}])) to volume 9fd14c7e-6e5c-4e73-a12e-3df49d0286f9. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92bdbc3-f54a-444a-a9aa-1b3f121a54d3]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:38:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ead4a640-2d85-4f8b-b035-f4d230f3163d_ddvmwocg {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:43 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ead4a640-2d85-4f8b-b035-f4d230f3163d_ddvmwocg Jun 01 09:38:43 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:44 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ead4a640-2d85-4f8b-b035-f4d230f3163d_ddvmwocg" returned: 0 in 0.738s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ead4a640-2d85-4f8b-b035-f4d230f3163d_ddvmwocg {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:44 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1cf2113d-875e-4150-ac3b-d4d2782220e1 1073741824" returned: 0 in 0.885s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1cf2113d-875e-4150-ac3b-d4d2782220e1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:44 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ead4a640-2d85-4f8b-b035-f4d230f3163d_ddvmwocg Jun 01 09:38:44 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:44 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1cf2113d-875e-4150-ac3b-d4d2782220e1 Jun 01 09:38:44 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:44 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ead4a640-2d85-4f8b-b035-f4d230f3163d_ddvmwocg" returned: 1 in 0.813s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ead4a640-2d85-4f8b-b035-f4d230f3163d_ddvmwocg' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0df02a-2b43-44cd-ab8e-380c7ffed9f5]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:44 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1cf2113d-875e-4150-ac3b-d4d2782220e1" returned: 0 in 0.764s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223a720a-be11-41b3-968d-0629878fdf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf2113d-875e-4150-ac3b-d4d2782220e1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171df1f6-6a27-4eb6-9ad0-542163cefc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:44 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD Jun 01 09:38:44 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Volume volume-1cf2113d-875e-4150-ac3b-d4d2782220e1 (1cf2113d-875e-4150-ac3b-d4d2782220e1): created successfully Jun 01 09:38:44 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171df1f6-6a27-4eb6-9ad0-542163cefc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Flow 'volume_create_manager' (3764aaf3-51b0-4258-ba1c-f29177c824d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:38:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-22133dc3-6dcc-4acc-a7ba-c82107ab66ae tempest-VolumesActionsTest-175257372 None] Created volume successfully. Jun 01 09:38:45 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD" returned: 0 in 0.729s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Acquiring lock "cinder-1cf2113d-875e-4150-ac3b-d4d2782220e1-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-1cf2113d-875e-4150-ac3b-d4d2782220e1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Acquiring lock "cinder-quobyte-1cf2113d-875e-4150-ac3b-d4d2782220e1" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-quobyte-1cf2113d-875e-4150-ac3b-d4d2782220e1" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:45 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD Jun 01 09:38:45 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:45 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfae3c9d-a8b5-4a14-9b9b-001a12b026b1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:38:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1cf2113d-875e-4150-ac3b-d4d2782220e1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:45 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1cf2113d-875e-4150-ac3b-d4d2782220e1 Jun 01 09:38:45 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:46 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD" returned: 1 in 0.763s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:38:46 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] ead4a640-2d85-4f8b-b035-f4d230f3163d was raw, converting to raw {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 01 09:38:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:46 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 Jun 01 09:38:46 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:46 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1cf2113d-875e-4150-ac3b-d4d2782220e1" returned: 0 in 0.793s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1cf2113d-875e-4150-ac3b-d4d2782220e1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:46 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1cf2113d-875e-4150-ac3b-d4d2782220e1 Jun 01 09:38:46 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:47 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9" returned: 0 in 0.701s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ead4a640-2d85-4f8b-b035-f4d230f3163d_d9khxnw5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:38:47 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Converted 0.00 MB image at 0.00 MB/s Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:47 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 1G Jun 01 09:38:47 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:47 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1cf2113d-875e-4150-ac3b-d4d2782220e1" returned: 0 in 0.617s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-quobyte-1cf2113d-875e-4150-ac3b-d4d2782220e1" released by "delete_volume" :: held 1.463s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Created reservations ['f56db4e9-5bb6-4bd6-a915-f4b61cf9f66b', '4973f432-7a48-4fa2-af0b-afaa8bcf795e', 'efee9802-98c1-42e8-a3b6-96602c96221a', '0028dbff-b6ea-4bde-b6f4-ee0a695f42df'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:47 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:38:47 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:47 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 1G" returned: 0 in 0.646s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[49476447-5727-4e4d-847b-ae506b987320]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:47 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 Jun 01 09:38:47 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:47 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.663s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:38:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Deleted volume successfully. Jun 01 09:38:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-20085f44-4fa9-458e-835e-f007209b9868 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-1cf2113d-875e-4150-ac3b-d4d2782220e1-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Flow 'volume_create_manager' (8b614a89-9803-41c9-85b9-05e5b6b2e4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e96ce7c-e15e-42a2-976e-f47099b8549c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e96ce7c-e15e-42a2-976e-f47099b8549c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-570738722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd199f7-125f-4aa1-b627-1761f5bbec65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4aa6a2524d4d03b29b7ddfc8782ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:38:48Z,use_quota=True,user_id='39aa572500044906952a42df04f97628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9982e09e-8680-4209-a20a-95671dd2ddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9982e09e-8680-4209-a20a-95671dd2ddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51289bcd-2a9c-486a-8c79-e1cbb1130293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51289bcd-2a9c-486a-8c79-e1cbb1130293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fd199f7-125f-4aa1-b627-1761f5bbec65', 'volume_name': 'volume-4fd199f7-125f-4aa1-b627-1761f5bbec65', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4835e7eb-3925-459f-b9d2-22420feb8427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4835e7eb-3925-459f-b9d2-22420feb8427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6609c7-bae5-484a-9e94-31998555a0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:48 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Volume 4fd199f7-125f-4aa1-b627-1761f5bbec65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fd199f7-125f-4aa1-b627-1761f5bbec65', 'volume_size': 1} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-570738722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd199f7-125f-4aa1-b627-1761f5bbec65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4aa6a2524d4d03b29b7ddfc8782ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:38:48Z,use_quota=True,user_id='39aa572500044906952a42df04f97628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Creating volume 4fd199f7-125f-4aa1-b627-1761f5bbec65 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:38:48 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4fd199f7-125f-4aa1-b627-1761f5bbec65 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:48 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4fd199f7-125f-4aa1-b627-1761f5bbec65 1073741824 Jun 01 09:38:48 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:48 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9" returned: 0 in 0.780s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:48 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 Jun 01 09:38:48 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:49 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4fd199f7-125f-4aa1-b627-1761f5bbec65 1073741824" returned: 0 in 0.902s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:49 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9" returned: 1 in 0.778s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Downloaded image ead4a640-2d85-4f8b-b035-f4d230f3163d ((None, [{'url': 'file:///opt/stack/data/glance/images/ead4a640-2d85-4f8b-b035-f4d230f3163d', 'metadata': {}}])) to volume 9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Temporary image ead4a640-2d85-4f8b-b035-f4d230f3163d for user 254478d4d48144bc85df9bedeb8fca18 is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Marking volume 9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4fd199f7-125f-4aa1-b627-1761f5bbec65 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Copying metadata from image ead4a640-2d85-4f8b-b035-f4d230f3163d to 9fd14c7e-6e5c-4e73-a12e-3df49d0286f9. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Creating volume glance metadata for volume 9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 backed by image ead4a640-2d85-4f8b-b035-f4d230f3163d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ead4a640-2d85-4f8b-b035-f4d230f3163d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ce4441867c2d192113802c0fbbacd460', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 01 09:38:49 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4fd199f7-125f-4aa1-b627-1761f5bbec65 Jun 01 09:38:49 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971ad755-c527-4673-9162-bc3dfd7d20ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9', 'volume_size': 1, 'image_id': 'ead4a640-2d85-4f8b-b035-f4d230f3163d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ead4a640-2d85-4f8b-b035-f4d230f3163d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce4441867c2d192113802c0fbbacd460', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49ae312de45946e7a813504856f3bb7c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d657c3a984d04e23b6e99b803909dd82227e6855e03755e1760e6dbe6b23f7a066ded7976fe5577e9f18553e7dca97695ee3f0fc886029c388ac46411f6ceec', 'id': 'ead4a640-2d85-4f8b-b035-f4d230f3163d', 'created_at': datetime.datetime(2026, 6, 1, 7, 38, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 38, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ead4a640-2d85-4f8b-b035-f4d230f3163d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6dd475-99f8-4edd-b9d8-333a185b8d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:49 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Volume volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 (9fd14c7e-6e5c-4e73-a12e-3df49d0286f9): created successfully Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6dd475-99f8-4edd-b9d8-333a185b8d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Flow 'volume_create_manager' (6f1f193c-35ba-4dc1-9f3b-b189640cba53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:38:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9c1c3ba5-4b6c-4a08-ab10-dcec4176d3b4 tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Created volume successfully. Jun 01 09:38:49 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4fd199f7-125f-4aa1-b627-1761f5bbec65" returned: 0 in 0.619s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:38:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6609c7-bae5-484a-9e94-31998555a0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fd199f7-125f-4aa1-b627-1761f5bbec65', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff92a0f1-5674-4970-9188-7dcbff48a8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:50 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Volume volume-4fd199f7-125f-4aa1-b627-1761f5bbec65 (4fd199f7-125f-4aa1-b627-1761f5bbec65): created successfully Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff92a0f1-5674-4970-9188-7dcbff48a8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Flow 'volume_create_manager' (8b614a89-9803-41c9-85b9-05e5b6b2e4b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:38:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-eacabf88-db7f-4eff-9756-5b6d2a145fc7 tempest-VolumesActionsTest-175257372 None] Created volume successfully. Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Acquiring lock "cinder-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Lock "cinder-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Acquiring lock "cinder-quobyte-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Lock "cinder-quobyte-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[49109760-94eb-4f4b-b032-b64e55ca25a0]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:50 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 Jun 01 09:38:50 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Acquiring lock "cinder-4fd199f7-125f-4aa1-b627-1761f5bbec65-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-4fd199f7-125f-4aa1-b627-1761f5bbec65-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Acquiring lock "cinder-quobyte-4fd199f7-125f-4aa1-b627-1761f5bbec65" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-quobyte-4fd199f7-125f-4aa1-b627-1761f5bbec65" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[114fe924-8aec-43ea-9069-011c548f8882]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:38:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4fd199f7-125f-4aa1-b627-1761f5bbec65 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:50 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4fd199f7-125f-4aa1-b627-1761f5bbec65 Jun 01 09:38:50 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:51 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9" returned: 0 in 0.987s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:51 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 Jun 01 09:38:51 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:51 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4fd199f7-125f-4aa1-b627-1761f5bbec65" returned: 0 in 1.239s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4fd199f7-125f-4aa1-b627-1761f5bbec65 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:51 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4fd199f7-125f-4aa1-b627-1761f5bbec65 Jun 01 09:38:51 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:52 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9" returned: 1 in 1.002s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:38:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:52 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9 Jun 01 09:38:52 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:52 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4fd199f7-125f-4aa1-b627-1761f5bbec65" returned: 0 in 0.648s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-quobyte-4fd199f7-125f-4aa1-b627-1761f5bbec65" released by "delete_volume" :: held 1.933s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:52 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Created reservations ['60c31a0a-fc0f-44db-a241-808d9c26cb2b', '97853416-06d6-4e1f-a822-3dafbf0a2352', '9ddf7aa8-f877-477f-b0a6-0510aab37bbb', '46d2fad7-e048-4ed0-8a9b-73a3acb85699'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:38:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:38:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:38:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:52 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:38:52 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:53 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9" returned: 0 in 0.876s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Lock "cinder-quobyte-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9" released by "delete_volume" :: held 2.981s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:53 devstack cinder-volume[86649]: WARNING cinder.quota [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:38:53 devstack cinder-volume[86649]: WARNING cinder.quota [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Created reservations ['1c5d8070-6c56-4e91-9aa7-56b6e65d7a02', '5423de26-0a24-442d-99ab-ae82ec8cc9a5', 'd76ee10e-347e-4972-aa02-42d582d3cf27', '5952e1d7-da3c-4c3d-b9f8-6360f5d441e7'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Flow 'volume_create_manager' (840c2747-c883-42dc-ab8c-718c07a25bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45954e8-92b6-47e6-8057-4811a3b898a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45954e8-92b6-47e6-8057-4811a3b898a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566894164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc30248-6d24-4bfc-b95f-aeac5639305e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4aa6a2524d4d03b29b7ddfc8782ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:38:53Z,use_quota=True,user_id='39aa572500044906952a42df04f97628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a09db629-0364-4708-91a6-da26e8344f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a09db629-0364-4708-91a6-da26e8344f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b5fd77-e1e0-414e-8190-492dc628baa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b5fd77-e1e0-414e-8190-492dc628baa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc30248-6d24-4bfc-b95f-aeac5639305e', 'volume_name': 'volume-6cc30248-6d24-4bfc-b95f-aeac5639305e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a54aadc5-9c12-4b90-8d19-7d29f98f234d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a54aadc5-9c12-4b90-8d19-7d29f98f234d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47f670f-fdb4-4ff6-93f0-e131959a23d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:53 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Volume 6cc30248-6d24-4bfc-b95f-aeac5639305e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc30248-6d24-4bfc-b95f-aeac5639305e', 'volume_size': 1} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566894164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc30248-6d24-4bfc-b95f-aeac5639305e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4aa6a2524d4d03b29b7ddfc8782ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:38:53Z,use_quota=True,user_id='39aa572500044906952a42df04f97628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Creating volume 6cc30248-6d24-4bfc-b95f-aeac5639305e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:38:53 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6cc30248-6d24-4bfc-b95f-aeac5639305e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:53 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6cc30248-6d24-4bfc-b95f-aeac5639305e 1073741824 Jun 01 09:38:53 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:53 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:38:53 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:53 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.094s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:38:53 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Deleted volume successfully. Jun 01 09:38:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a20be107-8ac9-41c6-a6c6-adf5addbe507 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-4fd199f7-125f-4aa1-b627-1761f5bbec65-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:54 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.657s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:54 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:38:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Deleted volume successfully. Jun 01 09:38:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aba7ce40-0fc8-4057-a080-09ce8b6acfbe tempest-VolumeAndVolumeTypeFromImageTest-1219327177 None] Lock "cinder-9fd14c7e-6e5c-4e73-a12e-3df49d0286f9-delete_volume" released by "delete_volume" :: held 4.163s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:54 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6cc30248-6d24-4bfc-b95f-aeac5639305e 1073741824" returned: 0 in 1.024s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6cc30248-6d24-4bfc-b95f-aeac5639305e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:54 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6cc30248-6d24-4bfc-b95f-aeac5639305e Jun 01 09:38:54 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:55 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6cc30248-6d24-4bfc-b95f-aeac5639305e" returned: 0 in 0.737s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:38:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47f670f-fdb4-4ff6-93f0-e131959a23d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc30248-6d24-4bfc-b95f-aeac5639305e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b153e08c-e0ef-4808-9394-c9195da404a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:55 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Volume volume-6cc30248-6d24-4bfc-b95f-aeac5639305e (6cc30248-6d24-4bfc-b95f-aeac5639305e): created successfully Jun 01 09:38:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b153e08c-e0ef-4808-9394-c9195da404a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Flow 'volume_create_manager' (840c2747-c883-42dc-ab8c-718c07a25bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:38:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f20b8448-f549-4da0-9b59-07303a9dbd6d tempest-VolumesActionsTest-175257372 None] Created volume successfully. Jun 01 09:38:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Acquiring lock "cinder-6cc30248-6d24-4bfc-b95f-aeac5639305e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-6cc30248-6d24-4bfc-b95f-aeac5639305e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Acquiring lock "cinder-quobyte-6cc30248-6d24-4bfc-b95f-aeac5639305e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:38:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-quobyte-6cc30248-6d24-4bfc-b95f-aeac5639305e" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:38:56 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a29c1ed-4168-4cec-b634-946554b6ad03]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:38:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6cc30248-6d24-4bfc-b95f-aeac5639305e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:56 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6cc30248-6d24-4bfc-b95f-aeac5639305e Jun 01 09:38:56 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:56 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6cc30248-6d24-4bfc-b95f-aeac5639305e" returned: 0 in 0.768s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6cc30248-6d24-4bfc-b95f-aeac5639305e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:56 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6cc30248-6d24-4bfc-b95f-aeac5639305e Jun 01 09:38:56 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:57 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6cc30248-6d24-4bfc-b95f-aeac5639305e" returned: 0 in 0.793s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-quobyte-6cc30248-6d24-4bfc-b95f-aeac5639305e" released by "delete_volume" :: held 1.615s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:57 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Created reservations ['d25874cf-6f74-4bbd-b447-d37709c58868', '6a397c5a-7849-4c67-aacc-52aa3fa877ae', '4e7868fc-3860-4cbc-b568-2e4e0355d4bf', '6fcdeed8-6c73-4fef-83e0-2fbc4331fe83'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:38:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:38:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:38:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:57 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:38:57 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:58 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.689s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:38:58 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Deleted volume successfully. Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-14f93e04-0a08-4c5e-bfc8-51fd053cffc6 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-6cc30248-6d24-4bfc-b95f-aeac5639305e-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Flow 'volume_create_manager' (7e76eac7-f145-41aa-b254-81c80021759a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae79633-a267-46b5-8090-4a91389d903e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae79633-a267-46b5-8090-4a91389d903e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2133444766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9fd338-ed48-4cb0-a2b7-6909f4b0d929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4aa6a2524d4d03b29b7ddfc8782ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:38:59Z,use_quota=True,user_id='39aa572500044906952a42df04f97628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3109dbaa-8d54-453c-b6b8-af73991d971f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3109dbaa-8d54-453c-b6b8-af73991d971f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3e591e-4d13-4b2c-8d36-817c08a6574d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3e591e-4d13-4b2c-8d36-817c08a6574d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e9fd338-ed48-4cb0-a2b7-6909f4b0d929', 'volume_name': 'volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31bedcb-b6a4-4a7f-a570-389a15a3d175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31bedcb-b6a4-4a7f-a570-389a15a3d175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95accb64-235c-4114-a6d6-2d232782f84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:38:58 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Volume 7e9fd338-ed48-4cb0-a2b7-6909f4b0d929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929', 'volume_size': 1} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2133444766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9fd338-ed48-4cb0-a2b7-6909f4b0d929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4aa6a2524d4d03b29b7ddfc8782ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:38:59Z,use_quota=True,user_id='39aa572500044906952a42df04f97628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Creating volume 7e9fd338-ed48-4cb0-a2b7-6909f4b0d929 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:38:58 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:38:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:58 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929 1073741824 Jun 01 09:38:58 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:59 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Jun 01 09:38:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929 1073741824" returned: 0 in 0.818s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:38:59 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=59,cinder:UPDATE=74,cinder:INSERT=20,cinder:DELETE=7 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:38:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:38:59 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929 Jun 01 09:38:59 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:38:59 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:38:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Flow 'volume_create_manager' (e6b62031-d3a2-453f-8361-b5430ff83f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:38:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200e8326-d171-4d19-8ee7-c62af7f7e16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200e8326-d171-4d19-8ee7-c62af7f7e16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-589637417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=389e6184-e7dc-4523-8704-98cdfa6bf892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a73a903c8ac4d36ad7cda531bf2dd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:00Z,use_quota=True,user_id='bdab900e54bd43de834fb50ebdf055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369f00b7-fc42-4f62-8a0d-0016dbd164e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369f00b7-fc42-4f62-8a0d-0016dbd164e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dee3730-c687-47fb-ac38-f5abe9392fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dee3730-c687-47fb-ac38-f5abe9392fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '389e6184-e7dc-4523-8704-98cdfa6bf892', 'volume_name': 'volume-389e6184-e7dc-4523-8704-98cdfa6bf892', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201d1e05-ed27-4945-ab1c-20e0288918ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201d1e05-ed27-4945-ab1c-20e0288918ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df31b30-1108-4987-8039-55672de6d9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:00 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume 389e6184-e7dc-4523-8704-98cdfa6bf892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-389e6184-e7dc-4523-8704-98cdfa6bf892', 'volume_size': 1} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:00 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929" returned: 0 in 0.630s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.422s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-589637417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=389e6184-e7dc-4523-8704-98cdfa6bf892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a73a903c8ac4d36ad7cda531bf2dd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:00Z,use_quota=True,user_id='bdab900e54bd43de834fb50ebdf055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Creating volume 389e6184-e7dc-4523-8704-98cdfa6bf892 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:00 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95accb64-235c-4114-a6d6-2d232782f84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:00 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892 1073741824 Jun 01 09:39:00 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd37667b-f2a3-4ff7-9bd6-015b09b1bd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:00 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Volume volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929 (7e9fd338-ed48-4cb0-a2b7-6909f4b0d929): created successfully Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd37667b-f2a3-4ff7-9bd6-015b09b1bd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Flow 'volume_create_manager' (7e76eac7-f145-41aa-b254-81c80021759a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-688b6f34-2c17-465a-b10b-541631d08c30 tempest-VolumesActionsTest-175257372 None] Created volume successfully. Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Acquiring lock "cinder-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Acquiring lock "cinder-quobyte-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-quobyte-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929" acquired by "delete_volume" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a549ba4-75f8-4464-bf81-a59c22c19410]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:01 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892 1073741824" returned: 0 in 0.838s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:01 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892 Jun 01 09:39:01 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:01 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929 Jun 01 09:39:01 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:01 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892" returned: 0 in 0.590s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df31b30-1108-4987-8039-55672de6d9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-389e6184-e7dc-4523-8704-98cdfa6bf892', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20283aff-0165-488d-b6b9-a2b3dee6697b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:01 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume volume-389e6184-e7dc-4523-8704-98cdfa6bf892 (389e6184-e7dc-4523-8704-98cdfa6bf892): created successfully Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20283aff-0165-488d-b6b9-a2b3dee6697b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Flow 'volume_create_manager' (e6b62031-d3a2-453f-8361-b5430ff83f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:02 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cf4e984e-7291-4709-b610-9ea23f90492f tempest-CreateVolumesFromSnapshotTest-1480523904 None] Created volume successfully. Jun 01 09:39:02 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929" returned: 0 in 0.736s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:02 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929 Jun 01 09:39:02 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Creating offline snapshot 2f4bc490-dbdf-40e7-b8d6-74e81bd82629 of volume 389e6184-e7dc-4523-8704-98cdfa6bf892 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a83333-ecfb-47f1-a3aa-21fac92dcb44]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:02 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892 Jun 01 09:39:02 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:02 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929" returned: 0 in 0.673s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-quobyte-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929" released by "delete_volume" :: held 1.457s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Created reservations ['d3f6089a-4c4f-4776-8fb5-d475a883806b', '33d9897f-91bf-4550-bd6c-a6596c2aee5e', '39fe5371-2d4b-4450-8d95-f7f720218a20', '336fcaf4-a59f-4bbc-b8b3-b3c3ca7980be'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:02 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:02 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:03 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892" returned: 0 in 0.727s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:03 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 1G Jun 01 09:39:03 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:03 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.620s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:03 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Deleted volume successfully. Jun 01 09:39:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3f393c66-4db3-45aa-8674-130a93f73420 tempest-VolumesActionsTest-1581729882 None] Lock "cinder-7e9fd338-ed48-4cb0-a2b7-6909f4b0d929-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:03 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 1G" returned: 0 in 0.833s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-389e6184-e7dc-4523-8704-98cdfa6bf892 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:04 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-389e6184-e7dc-4523-8704-98cdfa6bf892 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 Jun 01 09:39:04 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:04 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Flow 'volume_create_manager' (82037df9-d1d2-417b-b6a6-dab48a519627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2644392c-f535-439d-a09c-ce43d3b0f384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2644392c-f535-439d-a09c-ce43d3b0f384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-590006906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc6b248-d541-4f8d-81e2-bf7e230084d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4aa6a2524d4d03b29b7ddfc8782ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:04Z,use_quota=True,user_id='39aa572500044906952a42df04f97628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cab50a-ae68-44a8-98b5-d99b69fc0b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cab50a-ae68-44a8-98b5-d99b69fc0b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e97407-fb82-4d97-8bc4-fe1f51b63a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e97407-fb82-4d97-8bc4-fe1f51b63a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fc6b248-d541-4f8d-81e2-bf7e230084d5', 'volume_name': 'volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d8a57f8-7b7f-4c2e-824f-cce6e6896c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d8a57f8-7b7f-4c2e-824f-cce6e6896c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d86c1a-d6df-4698-975c-1a9093a4507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:04 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Volume 5fc6b248-d541-4f8d-81e2-bf7e230084d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5', 'volume_size': 1} Jun 01 09:39:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:04 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-389e6184-e7dc-4523-8704-98cdfa6bf892 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629" returned: 0 in 0.685s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:04 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 is being set with open permissions: ugo+rw Jun 01 09:39:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:04 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 Jun 01 09:39:04 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:05 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629" returned: 0 in 0.595s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:05 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.info Jun 01 09:39:05 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:05 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.info" returned: 0 in 0.598s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:05 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.info is being set with open permissions: ugo+rw Jun 01 09:39:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:05 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.info Jun 01 09:39:05 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:06 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.info" returned: 0 in 0.581s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.106s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.357s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-590006906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc6b248-d541-4f8d-81e2-bf7e230084d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4aa6a2524d4d03b29b7ddfc8782ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:04Z,use_quota=True,user_id='39aa572500044906952a42df04f97628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Creating volume 5fc6b248-d541-4f8d-81e2-bf7e230084d5 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:06 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:06 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5 1073741824 Jun 01 09:39:06 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8fe49b14-bea7-49b1-a0f6-1e009097c374 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Create snapshot completed successfully Jun 01 09:39:07 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5 1073741824" returned: 0 in 0.781s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:07 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5 Jun 01 09:39:07 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:07 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5" returned: 0 in 0.607s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d86c1a-d6df-4698-975c-1a9093a4507a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fa87d9-02c3-4cdb-9770-78bbadd822e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:07 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Volume volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5 (5fc6b248-d541-4f8d-81e2-bf7e230084d5): created successfully Jun 01 09:39:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fa87d9-02c3-4cdb-9770-78bbadd822e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Flow 'volume_create_manager' (82037df9-d1d2-417b-b6a6-dab48a519627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:07 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fbb33a38-b5ab-49b1-9791-0eb1d9bf4dcf tempest-VolumesActionsTest-175257372 None] Created volume successfully. Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Flow 'volume_create_manager' (690edc7a-0979-4293-b171-9b30ed902fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90fef8b-4234-42d3-9c48-a6d6346f0994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90fef8b-4234-42d3-9c48-a6d6346f0994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-881570235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a73a903c8ac4d36ad7cda531bf2dd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:08Z,use_quota=True,user_id='bdab900e54bd43de834fb50ebdf055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83dd356c-edb4-46e0-8bee-61ab3a034eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83dd356c-edb4-46e0-8bee-61ab3a034eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb6bcb8-145e-4662-8386-91747407b350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb6bcb8-145e-4662-8386-91747407b350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1', 'volume_name': 'volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6951c631-e540-4029-8068-c83ba25d2149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6951c631-e540-4029-8068-c83ba25d2149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fc78c2-beb4-4bd0-be65-bf3326957b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume 1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1', 'volume_size': 1} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-881570235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a73a903c8ac4d36ad7cda531bf2dd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:08Z,use_quota=True,user_id='bdab900e54bd43de834fb50ebdf055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Creating volume 1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:08 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:08 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1 1073741824 Jun 01 09:39:08 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Flow 'volume_create_manager' (55385013-6cdb-44d9-b0d0-31995414a3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8778236a-ff7a-49de-bbcf-31857b7505d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8778236a-ff7a-49de-bbcf-31857b7505d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1293053907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b68275-b0ea-4937-bf14-bf593f260865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a73a903c8ac4d36ad7cda531bf2dd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:08Z,use_quota=True,user_id='bdab900e54bd43de834fb50ebdf055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c737f4e-e115-49c6-bf04-3f67e5dcecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c737f4e-e115-49c6-bf04-3f67e5dcecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65425373-0c01-4cf7-99e6-a13a6ab9f39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65425373-0c01-4cf7-99e6-a13a6ab9f39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6b68275-b0ea-4937-bf14-bf593f260865', 'volume_name': 'volume-a6b68275-b0ea-4937-bf14-bf593f260865', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d822d2a-5a97-40a7-9f52-fa8312d02cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d822d2a-5a97-40a7-9f52-fa8312d02cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a2437f-c3be-48da-b50d-a59410129843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume a6b68275-b0ea-4937-bf14-bf593f260865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6b68275-b0ea-4937-bf14-bf593f260865', 'volume_size': 1} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Flow 'volume_create_manager' (4ffc4ef6-6e26-43aa-ab33-0877a5eac533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57317dc8-872e-47df-8f34-ff0d06eb71c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57317dc8-872e-47df-8f34-ff0d06eb71c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1547770331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535c3ebf-9ace-4407-9d49-453bf5a38708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a73a903c8ac4d36ad7cda531bf2dd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:09Z,use_quota=True,user_id='bdab900e54bd43de834fb50ebdf055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b99645-8bb8-4485-9a50-d421328d64ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b99645-8bb8-4485-9a50-d421328d64ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d737d284-4187-42ad-bc35-aaf0eba76e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d737d284-4187-42ad-bc35-aaf0eba76e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '535c3ebf-9ace-4407-9d49-453bf5a38708', 'volume_name': 'volume-535c3ebf-9ace-4407-9d49-453bf5a38708', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b2d588-91ab-4281-bb4d-193e0d7bf489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b2d588-91ab-4281-bb4d-193e0d7bf489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b6880d-5009-49d7-895c-8ba1bf39ebbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:08 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume 535c3ebf-9ace-4407-9d49-453bf5a38708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-535c3ebf-9ace-4407-9d49-453bf5a38708', 'volume_size': 1} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Acquiring lock "cinder-5fc6b248-d541-4f8d-81e2-bf7e230084d5-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Lock "cinder-5fc6b248-d541-4f8d-81e2-bf7e230084d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Acquiring lock "cinder-quobyte-5fc6b248-d541-4f8d-81e2-bf7e230084d5" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Lock "cinder-quobyte-5fc6b248-d541-4f8d-81e2-bf7e230084d5" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Flow 'volume_create_manager' (ae9aa073-d21e-4bff-8f50-cbced37d8bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:09 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd64c53-db91-44dd-afd7-4c0ec2a95f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[11928b53-57ee-4e9c-adaf-293674092d77]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1 1073741824" returned: 0 in 1.069s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd64c53-db91-44dd-afd7-4c0ec2a95f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1363031168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e98162-3da8-470c-8988-29f06ebdb6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a73a903c8ac4d36ad7cda531bf2dd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:09Z,use_quota=True,user_id='bdab900e54bd43de834fb50ebdf055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d38782d-a235-417b-8048-cea070d78b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d38782d-a235-417b-8048-cea070d78b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd07537-17fd-48ed-a599-5a52df57e322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd07537-17fd-48ed-a599-5a52df57e322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06e98162-3da8-470c-8988-29f06ebdb6f5', 'volume_name': 'volume-06e98162-3da8-470c-8988-29f06ebdb6f5', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ba822e-2d5b-47a4-959f-4425805f6a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ba822e-2d5b-47a4-959f-4425805f6a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038700a4-9d2f-43e2-aa48-dc966e45d248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:09 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume 06e98162-3da8-470c-8988-29f06ebdb6f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06e98162-3da8-470c-8988-29f06ebdb6f5', 'volume_size': 1} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:09 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5 Jun 01 09:39:09 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:09 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1 Jun 01 09:39:09 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Flow 'volume_create_manager' (9ef5304b-344c-4cf8-9991-2eddde472e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18b049f-da0d-49c4-aa1a-d8e58d47ae73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18b049f-da0d-49c4-aa1a-d8e58d47ae73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1013494083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957ebb96-32be-4121-b5a9-96b34c81cc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a73a903c8ac4d36ad7cda531bf2dd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:09Z,use_quota=True,user_id='bdab900e54bd43de834fb50ebdf055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fc0b73-e271-4d1f-a460-acac0da36dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fc0b73-e271-4d1f-a460-acac0da36dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd139043-39ef-4ab6-8d4d-815e3b7cda73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd139043-39ef-4ab6-8d4d-815e3b7cda73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '957ebb96-32be-4121-b5a9-96b34c81cc82', 'volume_name': 'volume-957ebb96-32be-4121-b5a9-96b34c81cc82', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ec87cf-9b24-4a23-bfac-7b474df5d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ec87cf-9b24-4a23-bfac-7b474df5d22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efe23e2-77b8-4eeb-9300-862ba0cbe26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:09 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume 957ebb96-32be-4121-b5a9-96b34c81cc82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-957ebb96-32be-4121-b5a9-96b34c81cc82', 'volume_size': 1} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:09 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1" returned: 0 in 0.625s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.398s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1293053907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b68275-b0ea-4937-bf14-bf593f260865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a73a903c8ac4d36ad7cda531bf2dd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:08Z,use_quota=True,user_id='bdab900e54bd43de834fb50ebdf055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Creating volume a6b68275-b0ea-4937-bf14-bf593f260865 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:09 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a6b68275-b0ea-4937-bf14-bf593f260865 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fc78c2-beb4-4bd0-be65-bf3326957b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:09 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a6b68275-b0ea-4937-bf14-bf593f260865 1073741824 Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cb6177-8689-41fd-867c-723e76420cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:09 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:09 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1 (1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1): created successfully Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cb6177-8689-41fd-867c-723e76420cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Flow 'volume_create_manager' (690edc7a-0979-4293-b171-9b30ed902fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:09 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d74ea68d-2a02-41bc-a2a8-b312dc398692 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Created volume successfully. Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5" returned: 0 in 0.816s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:09 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5 Jun 01 09:39:10 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:10 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5fc6b248-d541-4f8d-81e2-bf7e230084d5" returned: 0 in 0.612s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Lock "cinder-quobyte-5fc6b248-d541-4f8d-81e2-bf7e230084d5" released by "delete_volume" :: held 1.518s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:10 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Created reservations ['6c770964-2f34-44e9-b42d-0d74e5902493', '17270e9f-3041-4595-940f-beee25bd925a', 'f0cea2d9-b927-454f-8b2f-53a6e0857cba', '56d10984-b43b-4834-8101-ad78c65e2911'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:10 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a6b68275-b0ea-4937-bf14-bf593f260865 1073741824" returned: 0 in 0.850s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:10 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:10 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a6b68275-b0ea-4937-bf14-bf593f260865 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:10 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a6b68275-b0ea-4937-bf14-bf593f260865 Jun 01 09:39:10 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:11 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.623s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Deleted volume successfully. Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4d3b2fd3-8ef1-4956-bc12-4e5f964784e0 tempest-VolumesActionsTest-175257372 None] Lock "cinder-5fc6b248-d541-4f8d-81e2-bf7e230084d5-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:11 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a6b68275-b0ea-4937-bf14-bf593f260865" returned: 0 in 0.651s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.601s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1547770331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535c3ebf-9ace-4407-9d49-453bf5a38708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a73a903c8ac4d36ad7cda531bf2dd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:09Z,use_quota=True,user_id='bdab900e54bd43de834fb50ebdf055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Creating volume 535c3ebf-9ace-4407-9d49-453bf5a38708 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:11 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-535c3ebf-9ace-4407-9d49-453bf5a38708 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a2437f-c3be-48da-b50d-a59410129843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6b68275-b0ea-4937-bf14-bf593f260865', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:11 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-535c3ebf-9ace-4407-9d49-453bf5a38708 1073741824 Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18e8efc-9187-4f1a-a9c5-3519595b7332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:11 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:11 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume volume-a6b68275-b0ea-4937-bf14-bf593f260865 (a6b68275-b0ea-4937-bf14-bf593f260865): created successfully Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18e8efc-9187-4f1a-a9c5-3519595b7332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Flow 'volume_create_manager' (55385013-6cdb-44d9-b0d0-31995414a3fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4f280642-2874-472c-a32c-1c70e0c1d858 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Created volume successfully. Jun 01 09:39:12 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-535c3ebf-9ace-4407-9d49-453bf5a38708 1073741824" returned: 0 in 0.976s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-535c3ebf-9ace-4407-9d49-453bf5a38708 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:12 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-535c3ebf-9ace-4407-9d49-453bf5a38708 Jun 01 09:39:12 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:13 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-535c3ebf-9ace-4407-9d49-453bf5a38708" returned: 0 in 0.648s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.913s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1363031168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e98162-3da8-470c-8988-29f06ebdb6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a73a903c8ac4d36ad7cda531bf2dd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:09Z,use_quota=True,user_id='bdab900e54bd43de834fb50ebdf055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Creating volume 06e98162-3da8-470c-8988-29f06ebdb6f5 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:13 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-06e98162-3da8-470c-8988-29f06ebdb6f5 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b6880d-5009-49d7-895c-8ba1bf39ebbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535c3ebf-9ace-4407-9d49-453bf5a38708', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:13 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-06e98162-3da8-470c-8988-29f06ebdb6f5 1073741824 Jun 01 09:39:13 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb309fa2-6320-4f4b-b459-173e884658d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:13 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume volume-535c3ebf-9ace-4407-9d49-453bf5a38708 (535c3ebf-9ace-4407-9d49-453bf5a38708): created successfully Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb309fa2-6320-4f4b-b459-173e884658d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Flow 'volume_create_manager' (4ffc4ef6-6e26-43aa-ab33-0877a5eac533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ba29a486-c1c7-45ce-9c2d-cedcf9b33056 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Created volume successfully. Jun 01 09:39:14 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-06e98162-3da8-470c-8988-29f06ebdb6f5 1073741824" returned: 0 in 0.869s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-06e98162-3da8-470c-8988-29f06ebdb6f5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:14 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-06e98162-3da8-470c-8988-29f06ebdb6f5 Jun 01 09:39:14 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:14 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-06e98162-3da8-470c-8988-29f06ebdb6f5" returned: 0 in 0.664s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.138s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1013494083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957ebb96-32be-4121-b5a9-96b34c81cc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a73a903c8ac4d36ad7cda531bf2dd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:09Z,use_quota=True,user_id='bdab900e54bd43de834fb50ebdf055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Creating volume 957ebb96-32be-4121-b5a9-96b34c81cc82 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:14 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-957ebb96-32be-4121-b5a9-96b34c81cc82 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:14 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-957ebb96-32be-4121-b5a9-96b34c81cc82 1073741824 Jun 01 09:39:14 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038700a4-9d2f-43e2-aa48-dc966e45d248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e98162-3da8-470c-8988-29f06ebdb6f5', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91516554-7386-488b-a5f1-e0abcde2a5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:14 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume volume-06e98162-3da8-470c-8988-29f06ebdb6f5 (06e98162-3da8-470c-8988-29f06ebdb6f5): created successfully Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91516554-7386-488b-a5f1-e0abcde2a5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Flow 'volume_create_manager' (ae9aa073-d21e-4bff-8f50-cbced37d8bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fcb071af-3b50-4865-b53a-256cc07400a9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Created volume successfully. Jun 01 09:39:15 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-957ebb96-32be-4121-b5a9-96b34c81cc82 1073741824" returned: 0 in 0.872s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-957ebb96-32be-4121-b5a9-96b34c81cc82 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:15 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-957ebb96-32be-4121-b5a9-96b34c81cc82 Jun 01 09:39:15 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Flow 'volume_create_manager' (5ea1d93b-047f-4318-bc31-4a835a900db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd4d10f-8a2e-4286-9df6-468acb14ccb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:16 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd4d10f-8a2e-4286-9df6-468acb14ccb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1833294787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44124ff-39ac-433a-81e9-5e3c16582300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95edc71b7d5545dd9dfe66003ad99a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:16Z,use_quota=True,user_id='4556f162e5ee4c4280099d79ffb03334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1040acaf-f642-446e-942b-566bd4917034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1040acaf-f642-446e-942b-566bd4917034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b596087f-bb7e-4a6e-8280-5f49f9a0a9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b596087f-bb7e-4a6e-8280-5f49f9a0a9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44124ff-39ac-433a-81e9-5e3c16582300', 'volume_name': 'volume-a44124ff-39ac-433a-81e9-5e3c16582300', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8e13c4-8b54-4c2e-9583-33b6731e07c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8e13c4-8b54-4c2e-9583-33b6731e07c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8a07b8-8a3c-4533-a565-a68d2ff1b72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:16 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Volume a44124ff-39ac-433a-81e9-5e3c16582300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44124ff-39ac-433a-81e9-5e3c16582300', 'volume_size': 1} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-957ebb96-32be-4121-b5a9-96b34c81cc82" returned: 0 in 0.701s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1833294787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44124ff-39ac-433a-81e9-5e3c16582300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95edc71b7d5545dd9dfe66003ad99a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:16Z,use_quota=True,user_id='4556f162e5ee4c4280099d79ffb03334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Creating volume a44124ff-39ac-433a-81e9-5e3c16582300 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:16 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efe23e2-77b8-4eeb-9300-862ba0cbe26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-957ebb96-32be-4121-b5a9-96b34c81cc82', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cb752f-36cc-4dca-8ae7-1a36b50f0d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:16 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300 1073741824 Jun 01 09:39:16 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:16 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Volume volume-957ebb96-32be-4121-b5a9-96b34c81cc82 (957ebb96-32be-4121-b5a9-96b34c81cc82): created successfully Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cb752f-36cc-4dca-8ae7-1a36b50f0d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Flow 'volume_create_manager' (9ef5304b-344c-4cf8-9991-2eddde472e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fdbb13ae-a0b6-4bec-b7ef-84fecd8a39f8 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Created volume successfully. Jun 01 09:39:17 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300 1073741824" returned: 0 in 0.796s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:17 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300 Jun 01 09:39:17 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-957ebb96-32be-4121-b5a9-96b34c81cc82-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-957ebb96-32be-4121-b5a9-96b34c81cc82-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-quobyte-957ebb96-32be-4121-b5a9-96b34c81cc82" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-957ebb96-32be-4121-b5a9-96b34c81cc82" acquired by "delete_volume" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d94f96-5d4e-4c1e-9e93-ce7bd9f9a890]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-957ebb96-32be-4121-b5a9-96b34c81cc82 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:17 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-957ebb96-32be-4121-b5a9-96b34c81cc82 Jun 01 09:39:17 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:17 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300" returned: 0 in 0.731s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8a07b8-8a3c-4533-a565-a68d2ff1b72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44124ff-39ac-433a-81e9-5e3c16582300', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffa8eb8-1189-40ac-9af4-d38527cd32da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:17 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Volume volume-a44124ff-39ac-433a-81e9-5e3c16582300 (a44124ff-39ac-433a-81e9-5e3c16582300): created successfully Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffa8eb8-1189-40ac-9af4-d38527cd32da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Flow 'volume_create_manager' (5ea1d93b-047f-4318-bc31-4a835a900db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3360180e-0e5b-4fcc-9923-8772f2ee0887 tempest-AttachVolumeNegativeTest-312487544 None] Created volume successfully. Jun 01 09:39:18 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-957ebb96-32be-4121-b5a9-96b34c81cc82" returned: 0 in 0.851s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-957ebb96-32be-4121-b5a9-96b34c81cc82 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:18 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-957ebb96-32be-4121-b5a9-96b34c81cc82 Jun 01 09:39:18 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:19 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-957ebb96-32be-4121-b5a9-96b34c81cc82" returned: 0 in 0.643s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-957ebb96-32be-4121-b5a9-96b34c81cc82" released by "delete_volume" :: held 1.556s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Created reservations ['a2c989a7-abeb-47bf-ad39-2336e068fe97', 'f6ff8fd1-3310-4dbe-a6c0-a8165deccc75', 'e60a7ce4-6c2a-4d2a-a95b-e9a84acd56b9', 'afe86c79-9cfd-4275-bba0-9573169b8836'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:19 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:19 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-06e98162-3da8-470c-8988-29f06ebdb6f5-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-06e98162-3da8-470c-8988-29f06ebdb6f5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-quobyte-06e98162-3da8-470c-8988-29f06ebdb6f5" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-06e98162-3da8-470c-8988-29f06ebdb6f5" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a17e564-4d60-4c10-bd28-dd44e2853f6a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-06e98162-3da8-470c-8988-29f06ebdb6f5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:19 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.724s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Deleted volume successfully. Jun 01 09:39:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3281b27a-a005-4e40-b48c-86e1bc006608 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-957ebb96-32be-4121-b5a9-96b34c81cc82-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:20 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-06e98162-3da8-470c-8988-29f06ebdb6f5 Jun 01 09:39:20 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:20 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-06e98162-3da8-470c-8988-29f06ebdb6f5" returned: 0 in 0.783s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-06e98162-3da8-470c-8988-29f06ebdb6f5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:20 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-06e98162-3da8-470c-8988-29f06ebdb6f5 Jun 01 09:39:20 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:21 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-06e98162-3da8-470c-8988-29f06ebdb6f5" returned: 0 in 0.628s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-06e98162-3da8-470c-8988-29f06ebdb6f5" released by "delete_volume" :: held 1.473s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:21 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Created reservations ['b1cc5348-0534-4361-8b47-337612b4310b', '16acc722-1f44-4663-860d-4528a82c9864', 'c0406c0c-e7e0-453b-bbbb-817656d57fc4', '34332982-f2e7-4abe-a77c-ab488600e160'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:21 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:21 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-71e9e8c9-5ed2-4f8c-8905-3c34d3ad8014 req-7e2e382e-9328-41d9-a241-958277b9b12f tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-71e9e8c9-5ed2-4f8c-8905-3c34d3ad8014 req-7e2e382e-9328-41d9-a241-958277b9b12f tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:21 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5efa7f3-307c-413d-a41b-fb925c6f96f6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-71e9e8c9-5ed2-4f8c-8905-3c34d3ad8014 req-7e2e382e-9328-41d9-a241-958277b9b12f tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:21 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300 Jun 01 09:39:21 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-535c3ebf-9ace-4407-9d49-453bf5a38708-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-535c3ebf-9ace-4407-9d49-453bf5a38708-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-quobyte-535c3ebf-9ace-4407-9d49-453bf5a38708" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-535c3ebf-9ace-4407-9d49-453bf5a38708" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:22 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[764a6fcb-15f3-4052-8a00-9e69f5c51759]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-535c3ebf-9ace-4407-9d49-453bf5a38708 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:22 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.756s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:22 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Deleted volume successfully. Jun 01 09:39:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-64021e4a-56e7-4e58-aec6-40b1f7bd1ae9 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-06e98162-3da8-470c-8988-29f06ebdb6f5-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:22 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-535c3ebf-9ace-4407-9d49-453bf5a38708 Jun 01 09:39:22 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:22 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-71e9e8c9-5ed2-4f8c-8905-3c34d3ad8014 req-7e2e382e-9328-41d9-a241-958277b9b12f tempest-AttachVolumeNegativeTest-312487544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300" returned: 0 in 0.868s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-71e9e8c9-5ed2-4f8c-8905-3c34d3ad8014 req-7e2e382e-9328-41d9-a241-958277b9b12f tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.889s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-71e9e8c9-5ed2-4f8c-8905-3c34d3ad8014 req-7e2e382e-9328-41d9-a241-958277b9b12f tempest-AttachVolumeNegativeTest-312487544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-a44124ff-39ac-433a-81e9-5e3c16582300', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b4c3b72-e567-4884-8d98-2a654fbce3d7', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:39:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-71e9e8c9-5ed2-4f8c-8905-3c34d3ad8014 req-7e2e382e-9328-41d9-a241-958277b9b12f tempest-AttachVolumeNegativeTest-312487544 None] attachment_update completed successfully. Jun 01 09:39:22 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-535c3ebf-9ace-4407-9d49-453bf5a38708" returned: 0 in 0.780s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-535c3ebf-9ace-4407-9d49-453bf5a38708 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:22 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-535c3ebf-9ace-4407-9d49-453bf5a38708 Jun 01 09:39:22 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Flow 'volume_create_manager' (4df64d5a-f631-47d1-adeb-6f2047f3d7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660fd19d-924d-4c29-bc1b-e004c6272297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660fd19d-924d-4c29-bc1b-e004c6272297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1177245060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8149a40b-7645-43e1-b4bb-3f94166265dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95609bdb2941425db20f063a5f3c10b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:23Z,use_quota=True,user_id='293a29d17eb443ff8d3d7fe2c1c9f977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ea3f35-6249-4afc-a37e-124cd998f381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ea3f35-6249-4afc-a37e-124cd998f381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f0ada1-3bd9-41be-895d-a8e9fbe40bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f0ada1-3bd9-41be-895d-a8e9fbe40bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8149a40b-7645-43e1-b4bb-3f94166265dd', 'volume_name': 'volume-8149a40b-7645-43e1-b4bb-3f94166265dd', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de7a155-a061-4f85-b902-f8c0389a72c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de7a155-a061-4f85-b902-f8c0389a72c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2240eb5-887d-496f-b78d-d9b95ddedc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:23 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Volume 8149a40b-7645-43e1-b4bb-3f94166265dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8149a40b-7645-43e1-b4bb-3f94166265dd', 'volume_size': 1} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1177245060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8149a40b-7645-43e1-b4bb-3f94166265dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95609bdb2941425db20f063a5f3c10b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:23Z,use_quota=True,user_id='293a29d17eb443ff8d3d7fe2c1c9f977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Creating volume 8149a40b-7645-43e1-b4bb-3f94166265dd {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:23 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8149a40b-7645-43e1-b4bb-3f94166265dd 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:23 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8149a40b-7645-43e1-b4bb-3f94166265dd 1073741824 Jun 01 09:39:23 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:23 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-535c3ebf-9ace-4407-9d49-453bf5a38708" returned: 0 in 0.692s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-535c3ebf-9ace-4407-9d49-453bf5a38708" released by "delete_volume" :: held 1.533s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Created reservations ['d2c2d320-12b6-4ddc-9a04-434f81f9a4c2', 'f3883d94-062c-4a73-82a1-671889c2fdfe', 'db305c3c-828d-4d61-913f-04fb7c6addd0', '0ce931e0-e697-4881-b836-c087e8c51822'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:23 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:23 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:24 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8149a40b-7645-43e1-b4bb-3f94166265dd 1073741824" returned: 0 in 0.794s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8149a40b-7645-43e1-b4bb-3f94166265dd {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:24 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8149a40b-7645-43e1-b4bb-3f94166265dd Jun 01 09:39:24 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-a6b68275-b0ea-4937-bf14-bf593f260865-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-a6b68275-b0ea-4937-bf14-bf593f260865-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-quobyte-a6b68275-b0ea-4937-bf14-bf593f260865" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-a6b68275-b0ea-4937-bf14-bf593f260865" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e210c3e-da4b-4f59-b23d-7fe6cea0db73]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a6b68275-b0ea-4937-bf14-bf593f260865 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:24 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.714s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:24 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Deleted volume successfully. Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-af080b5d-bec9-41b0-a752-ffb6e87b65dd tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-535c3ebf-9ace-4407-9d49-453bf5a38708-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:24 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a6b68275-b0ea-4937-bf14-bf593f260865 Jun 01 09:39:24 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:24 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8149a40b-7645-43e1-b4bb-3f94166265dd" returned: 0 in 0.665s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2240eb5-887d-496f-b78d-d9b95ddedc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8149a40b-7645-43e1-b4bb-3f94166265dd', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cc7be4-66ba-4652-a498-2b55155ca447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:24 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Volume volume-8149a40b-7645-43e1-b4bb-3f94166265dd (8149a40b-7645-43e1-b4bb-3f94166265dd): created successfully Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cc7be4-66ba-4652-a498-2b55155ca447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Flow 'volume_create_manager' (4df64d5a-f631-47d1-adeb-6f2047f3d7d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:24 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d6bfb38c-672c-4156-9d4a-42b135c1eee4 tempest-VolumesListAdminTestJSON-1909518785 None] Created volume successfully. Jun 01 09:39:25 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a6b68275-b0ea-4937-bf14-bf593f260865" returned: 0 in 0.722s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a6b68275-b0ea-4937-bf14-bf593f260865 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:25 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a6b68275-b0ea-4937-bf14-bf593f260865 Jun 01 09:39:25 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:25 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a6b68275-b0ea-4937-bf14-bf593f260865" returned: 0 in 0.635s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-a6b68275-b0ea-4937-bf14-bf593f260865" released by "delete_volume" :: held 1.412s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Flow 'volume_create_manager' (6d9b706e-f972-4511-843f-c1ecb45a91db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e818bcdb-5647-41da-99bc-57bbfb86147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e818bcdb-5647-41da-99bc-57bbfb86147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-414169567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ce85ee-a5de-4218-a5b5-e5028c76320a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95609bdb2941425db20f063a5f3c10b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:26Z,use_quota=True,user_id='293a29d17eb443ff8d3d7fe2c1c9f977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47e89e2-af0c-49bd-b9c9-30a771b64bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47e89e2-af0c-49bd-b9c9-30a771b64bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c4d0fa-c625-40e7-b786-815c5f3c2b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c4d0fa-c625-40e7-b786-815c5f3c2b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4ce85ee-a5de-4218-a5b5-e5028c76320a', 'volume_name': 'volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0590a0f4-c93c-4182-b10c-6a876e87cc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0590a0f4-c93c-4182-b10c-6a876e87cc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cc7f78-8bbd-4149-921d-67290303d455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:25 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Volume a4ce85ee-a5de-4218-a5b5-e5028c76320a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a', 'volume_size': 1} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-414169567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ce85ee-a5de-4218-a5b5-e5028c76320a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95609bdb2941425db20f063a5f3c10b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:26Z,use_quota=True,user_id='293a29d17eb443ff8d3d7fe2c1c9f977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Creating volume a4ce85ee-a5de-4218-a5b5-e5028c76320a {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:25 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:25 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a 1073741824 Jun 01 09:39:25 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Created reservations ['650dc9ac-b253-488a-b524-e04b8ce71508', 'a3ad434e-7d87-4deb-8f27-fa451da5f9d7', '8f33ef01-82b5-461a-aa45-310f51c47217', 'ed16b86e-bcb3-4e8a-bcc7-c601495dc09e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:26 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:26 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-quobyte-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:26 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.626s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:26 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1" acquired by "delete_volume" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:26 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Deleted volume successfully. Jun 01 09:39:26 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0248e1d1-c279-4f38-a4b8-8481c890309d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-76965534-b592-4256-b74e-2a7efe19b33c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-a6b68275-b0ea-4937-bf14-bf593f260865-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:26 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a 1073741824" returned: 0 in 0.882s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:26 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1 Jun 01 09:39:26 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:26 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a Jun 01 09:39:26 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:27 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a" returned: 0 in 0.580s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:27 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1" returned: 0 in 0.750s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cc7f78-8bbd-4149-921d-67290303d455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4120aafa-1567-45af-bd07-fb2af84d5c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:27 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1 Jun 01 09:39:27 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:27 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Volume volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a (a4ce85ee-a5de-4218-a5b5-e5028c76320a): created successfully Jun 01 09:39:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4120aafa-1567-45af-bd07-fb2af84d5c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Flow 'volume_create_manager' (6d9b706e-f972-4511-843f-c1ecb45a91db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:27 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6d3585ae-44d9-4616-a720-47b00598aed7 tempest-VolumesListAdminTestJSON-1909518785 None] Created volume successfully. Jun 01 09:39:28 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1" returned: 0 in 0.651s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1" released by "delete_volume" :: held 1.444s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Created reservations ['2f04f1f3-b2ea-4a52-a105-0d65fea74306', '023668d2-f75d-400b-a967-293a0408ed98', '11028034-2e15-4e2e-9457-d79f95a2abac', '51f8102e-fa42-4a2d-b47a-b198b89417a2'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:28 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:28 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Flow 'volume_create_manager' (4713bb44-de0e-4b56-97d6-a0076e0e69fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50efef3-e6c3-4e53-94b2-68df47e61cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50efef3-e6c3-4e53-94b2-68df47e61cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1570730451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f70e5d-a019-4ba8-96ab-2d95a655390a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95609bdb2941425db20f063a5f3c10b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:28Z,use_quota=True,user_id='293a29d17eb443ff8d3d7fe2c1c9f977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f8e93d-2b41-4456-a723-29d1c9ca7649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f8e93d-2b41-4456-a723-29d1c9ca7649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c78db5-b63b-4060-b04f-59a18a7811bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c78db5-b63b-4060-b04f-59a18a7811bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f70e5d-a019-4ba8-96ab-2d95a655390a', 'volume_name': 'volume-84f70e5d-a019-4ba8-96ab-2d95a655390a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42e44e8-e027-43f9-a355-00aa3c3d9021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42e44e8-e027-43f9-a355-00aa3c3d9021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d973b3d-24d4-466d-90ab-f03e846a6b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Volume 84f70e5d-a019-4ba8-96ab-2d95a655390a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f70e5d-a019-4ba8-96ab-2d95a655390a', 'volume_size': 1} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1570730451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f70e5d-a019-4ba8-96ab-2d95a655390a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95609bdb2941425db20f063a5f3c10b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:28Z,use_quota=True,user_id='293a29d17eb443ff8d3d7fe2c1c9f977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Creating volume 84f70e5d-a019-4ba8-96ab-2d95a655390a {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:28 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-84f70e5d-a019-4ba8-96ab-2d95a655390a 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:28 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-84f70e5d-a019-4ba8-96ab-2d95a655390a 1073741824 Jun 01 09:39:28 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-2f4bc490-dbdf-40e7-b8d6-74e81bd82629-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:28 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.623s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-2f4bc490-dbdf-40e7-b8d6-74e81bd82629-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-quobyte-389e6184-e7dc-4523-8704-98cdfa6bf892" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Deleted volume successfully. Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-389e6184-e7dc-4523-8704-98cdfa6bf892" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-quobyte-2f4bc490-dbdf-40e7-b8d6-74e81bd82629" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-17177527-8ce5-465b-98d9-42267340e26c tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-1b0c5c70-28f9-45df-b9d4-ee1ab00da2c1-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-2f4bc490-dbdf-40e7-b8d6-74e81bd82629" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Deleting offline snapshot 2f4bc490-dbdf-40e7-b8d6-74e81bd82629 of volume 389e6184-e7dc-4523-8704-98cdfa6bf892 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] snapshot_file for this snap is: volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c2aefd-aa6d-48c9-a240-cfe0f4b369c9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:28 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 Jun 01 09:39:28 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-72b22fba-876a-4c98-ae45-1baeaa1bcb8e req-4faad763-b410-4cd0-8cf5-f693773cdd4a tempest-AttachVolumeNegativeTest-312487544 None] Terminate volume connection completed successfully. Jun 01 09:39:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-72b22fba-876a-4c98-ae45-1baeaa1bcb8e req-4faad763-b410-4cd0-8cf5-f693773cdd4a tempest-AttachVolumeNegativeTest-312487544 None] Deleting attachment 7b4c3b72-e567-4884-8d98-2a654fbce3d7. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:39:29 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-84f70e5d-a019-4ba8-96ab-2d95a655390a 1073741824" returned: 0 in 0.908s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-84f70e5d-a019-4ba8-96ab-2d95a655390a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:29 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-84f70e5d-a019-4ba8-96ab-2d95a655390a Jun 01 09:39:29 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:29 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629" returned: 0 in 0.809s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-389e6184-e7dc-4523-8704-98cdfa6bf892(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:39:29 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c77543c-ecd4-4bcd-a291-65d995a8b23d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:29 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892 Jun 01 09:39:29 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:29 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-84f70e5d-a019-4ba8-96ab-2d95a655390a" returned: 0 in 0.605s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d973b3d-24d4-466d-90ab-f03e846a6b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f70e5d-a019-4ba8-96ab-2d95a655390a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72803095-fc7d-4899-b324-51f02e7bb6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:30 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Volume volume-84f70e5d-a019-4ba8-96ab-2d95a655390a (84f70e5d-a019-4ba8-96ab-2d95a655390a): created successfully Jun 01 09:39:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72803095-fc7d-4899-b324-51f02e7bb6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Flow 'volume_create_manager' (4713bb44-de0e-4b56-97d6-a0076e0e69fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d10fe1aa-8f85-42db-a613-ef2bf0d54364 tempest-VolumesListAdminTestJSON-1909518785 None] Created volume successfully. Jun 01 09:39:30 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892" returned: 0 in 0.702s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:30 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 Jun 01 09:39:30 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Flow 'volume_create_manager' (b34f3b17-a9e1-4671-980a-3cb6e21d6840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b956c6-d22b-4e68-b55e-cc3dcd06f948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b956c6-d22b-4e68-b55e-cc3dcd06f948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1d1069-46a6-4115-8309-5ae94929b4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='163b0b4c985d487b8c7057e2cc1d6b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:31Z,use_quota=True,user_id='4c7e64ddd67b48ada8e689aac2c26eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c40478a-2456-4c79-8da4-71f377737193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c40478a-2456-4c79-8da4-71f377737193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16e25d9-3f9a-4347-ba2f-1e1fc2bc3857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16e25d9-3f9a-4347-ba2f-1e1fc2bc3857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d1d1069-46a6-4115-8309-5ae94929b4b2', 'volume_name': 'volume-0d1d1069-46a6-4115-8309-5ae94929b4b2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b60442a-910b-471d-bda1-c54a252e5714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b60442a-910b-471d-bda1-c54a252e5714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59a4aaf-d7a2-4f63-8cc4-5b3dc7d7a4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:31 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Volume 0d1d1069-46a6-4115-8309-5ae94929b4b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d1d1069-46a6-4115-8309-5ae94929b4b2', 'volume_size': 1} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:31 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1d1069-46a6-4115-8309-5ae94929b4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='163b0b4c985d487b8c7057e2cc1d6b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:31Z,use_quota=True,user_id='4c7e64ddd67b48ada8e689aac2c26eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Creating volume 0d1d1069-46a6-4115-8309-5ae94929b4b2 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:31 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d1d1069-46a6-4115-8309-5ae94929b4b2 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629" returned: 0 in 0.731s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:31 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d1d1069-46a6-4115-8309-5ae94929b4b2 1073741824 Jun 01 09:39:31 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:31 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629 Jun 01 09:39:31 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:31 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892.2f4bc490-dbdf-40e7-b8d6-74e81bd82629" returned: 0 in 0.633s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-2f4bc490-dbdf-40e7-b8d6-74e81bd82629" released by "_delete_snapshot" :: held 2.972s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-389e6184-e7dc-4523-8704-98cdfa6bf892" released by "delete_snapshot" :: held 2.999s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Created reservations ['594ed28a-7a7c-4138-be5b-739dd165c194', 'f6d68ec7-e163-47ec-befc-7f8ec0012f9c', '9689b461-8a33-46ac-9d68-ab050e873e44', 'c865189f-cc59-4ed4-b4c4-6645af9b8150'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Delete snapshot completed successfully. Jun 01 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b958dbd0-dbd3-4b83-93d5-917f9a91a187 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-2f4bc490-dbdf-40e7-b8d6-74e81bd82629-delete_snapshot" released by "delete_snapshot" :: held 3.166s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:32 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d1d1069-46a6-4115-8309-5ae94929b4b2 1073741824" returned: 0 in 0.884s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-389e6184-e7dc-4523-8704-98cdfa6bf892-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d1d1069-46a6-4115-8309-5ae94929b4b2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-389e6184-e7dc-4523-8704-98cdfa6bf892-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:32 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d1d1069-46a6-4115-8309-5ae94929b4b2 Jun 01 09:39:32 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "cinder-quobyte-389e6184-e7dc-4523-8704-98cdfa6bf892" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-389e6184-e7dc-4523-8704-98cdfa6bf892" acquired by "delete_volume" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c1c60f-42ac-48d0-99e0-d1ec7c34af49]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:32 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892 Jun 01 09:39:32 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:33 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d1d1069-46a6-4115-8309-5ae94929b4b2" returned: 0 in 0.931s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59a4aaf-d7a2-4f63-8cc4-5b3dc7d7a4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1d1069-46a6-4115-8309-5ae94929b4b2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b2bf008-9e74-4759-9eef-023d4c49463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:33 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Volume volume-0d1d1069-46a6-4115-8309-5ae94929b4b2 (0d1d1069-46a6-4115-8309-5ae94929b4b2): created successfully Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b2bf008-9e74-4759-9eef-023d4c49463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Flow 'volume_create_manager' (b34f3b17-a9e1-4671-980a-3cb6e21d6840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:33 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8295211b-c7b6-4070-8a7b-5eb06dcca66b tempest-VolumesListAdminTestJSON-1506456073 None] Created volume successfully. Jun 01 09:39:33 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892" returned: 0 in 1.070s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:33 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892 Jun 01 09:39:33 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:33 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-389e6184-e7dc-4523-8704-98cdfa6bf892" returned: 0 in 0.616s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-quobyte-389e6184-e7dc-4523-8704-98cdfa6bf892" released by "delete_volume" :: held 1.751s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Created reservations ['d52e1873-674a-4dd0-90e2-809801c23408', 'a5eec75a-c9cb-4f24-a85a-7d3d80fc395a', '81174557-61ee-4c82-9bc8-14cd2e6a2643', 'afd096bb-ab8d-4482-a0f6-86f1a5d872dc'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:34 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:34 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Acquiring lock "cinder-0d1d1069-46a6-4115-8309-5ae94929b4b2-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Lock "cinder-0d1d1069-46a6-4115-8309-5ae94929b4b2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Acquiring lock "cinder-quobyte-0d1d1069-46a6-4115-8309-5ae94929b4b2" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Lock "cinder-quobyte-0d1d1069-46a6-4115-8309-5ae94929b4b2" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[755973d1-d2de-408d-a8f8-5a492b979924]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d1d1069-46a6-4115-8309-5ae94929b4b2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "cinder-84f70e5d-a019-4ba8-96ab-2d95a655390a-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Lock "cinder-84f70e5d-a019-4ba8-96ab-2d95a655390a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:34 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d1d1069-46a6-4115-8309-5ae94929b4b2 Jun 01 09:39:34 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:34 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.761s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "cinder-quobyte-84f70e5d-a019-4ba8-96ab-2d95a655390a" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Deleted volume successfully. Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Lock "cinder-quobyte-84f70e5d-a019-4ba8-96ab-2d95a655390a" acquired by "delete_volume" :: waited 0.038s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b9417f6-6140-48f0-b395-2338f2b0ed83 tempest-CreateVolumesFromSnapshotTest-1480523904 None] Lock "cinder-389e6184-e7dc-4523-8704-98cdfa6bf892-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0977a8-28d8-498e-bc28-3a1a59dd6d9f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-84f70e5d-a019-4ba8-96ab-2d95a655390a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:35 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-84f70e5d-a019-4ba8-96ab-2d95a655390a Jun 01 09:39:35 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:35 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d1d1069-46a6-4115-8309-5ae94929b4b2" returned: 0 in 0.872s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d1d1069-46a6-4115-8309-5ae94929b4b2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:35 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d1d1069-46a6-4115-8309-5ae94929b4b2 Jun 01 09:39:35 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:35 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-84f70e5d-a019-4ba8-96ab-2d95a655390a" returned: 0 in 0.798s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-84f70e5d-a019-4ba8-96ab-2d95a655390a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:35 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-84f70e5d-a019-4ba8-96ab-2d95a655390a Jun 01 09:39:35 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:36 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0d1d1069-46a6-4115-8309-5ae94929b4b2" returned: 0 in 0.690s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Lock "cinder-quobyte-0d1d1069-46a6-4115-8309-5ae94929b4b2" released by "delete_volume" :: held 1.614s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Created reservations ['df656c16-3a0b-49e0-a5fb-a15500f6034e', '62352015-a7e3-45cb-a8c4-6f9b47415b38', '1b99c73e-8635-47d6-9bb5-6270dc4b9601', '21945ae4-b6ce-4f3d-ad95-7346c51b9b88'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:36 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:36 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:36 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-84f70e5d-a019-4ba8-96ab-2d95a655390a" returned: 0 in 0.769s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Lock "cinder-quobyte-84f70e5d-a019-4ba8-96ab-2d95a655390a" released by "delete_volume" :: held 1.658s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Created reservations ['2eebc77b-e237-49e3-99c8-5ea9789d6a06', '9dde698b-2a72-4fc8-8154-0b46afd3d50a', '90e478ec-8175-48c9-b8f1-00750c7d5d8d', 'b40dfa17-cecc-442e-ad36-24bdea914227'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:36 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:36 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:36 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:36 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "cinder-a4ce85ee-a5de-4218-a5b5-e5028c76320a-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Lock "cinder-a4ce85ee-a5de-4218-a5b5-e5028c76320a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:37 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.793s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Deleted volume successfully. Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c77cf83b-17cf-49e6-8761-cc2e54f47b7c tempest-VolumesListAdminTestJSON-1506456073 None] Lock "cinder-0d1d1069-46a6-4115-8309-5ae94929b4b2-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "cinder-quobyte-a4ce85ee-a5de-4218-a5b5-e5028c76320a" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Lock "cinder-quobyte-a4ce85ee-a5de-4218-a5b5-e5028c76320a" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a511e93c-9bfd-4116-9c6e-f3e70db858e0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:37 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a Jun 01 09:39:37 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:37 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.726s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:37 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.861s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Deleted volume successfully. Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0fdefa2e-abc2-4619-b8bb-1f3719c5d54d tempest-VolumesListAdminTestJSON-1909518785 None] Lock "cinder-84f70e5d-a019-4ba8-96ab-2d95a655390a-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Flow 'volume_create_manager' (35ec14ce-5607-4c0b-b2bb-f18ad035c209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101f78d1-28ac-43da-870c-3b9d8dbe9775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101f78d1-28ac-43da-870c-3b9d8dbe9775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1628287478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef8bf1a4a6c4a4eb326da8c90f872d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:38Z,use_quota=True,user_id='6e13a53d75e14d39b7ee2a06f876ba21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358c86a0-bd55-4c92-86e6-9e4fcc8c5822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358c86a0-bd55-4c92-86e6-9e4fcc8c5822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436d3bd1-41e0-4249-9935-956cccc94865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436d3bd1-41e0-4249-9935-956cccc94865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a', 'volume_name': 'volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af12b09f-8510-41e8-b1d7-1ea769c4ab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af12b09f-8510-41e8-b1d7-1ea769c4ab5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cd03cb-4544-4313-9799-6ac3ec82b8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:37 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume 57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a', 'volume_size': 1} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1628287478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef8bf1a4a6c4a4eb326da8c90f872d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:38Z,use_quota=True,user_id='6e13a53d75e14d39b7ee2a06f876ba21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Creating volume 57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:37 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:38 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a 1073741824 Jun 01 09:39:38 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:38 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a" returned: 0 in 0.803s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:38 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a Jun 01 09:39:38 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:38 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a4ce85ee-a5de-4218-a5b5-e5028c76320a" returned: 0 in 0.595s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Lock "cinder-quobyte-a4ce85ee-a5de-4218-a5b5-e5028c76320a" released by "delete_volume" :: held 1.453s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:38 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Created reservations ['1a29d9c0-51fd-42a6-89b8-c18dcd834e37', '8d4ca37e-9d04-4235-8658-82632b2822b4', 'c3636e82-b640-4aa7-af8e-65bfd3f1ace7', '7184f380-ea35-460b-a10a-022f239b549d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:38 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:38 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:38 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a 1073741824" returned: 0 in 0.777s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:38 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a Jun 01 09:39:38 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:39 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.604s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:39 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Deleted volume successfully. Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa8ea08c-08ec-4e80-ab2c-62804afb368f tempest-VolumesListAdminTestJSON-1909518785 None] Lock "cinder-a4ce85ee-a5de-4218-a5b5-e5028c76320a-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "cinder-8149a40b-7645-43e1-b4bb-3f94166265dd-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:39 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a" returned: 0 in 0.654s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cd03cb-4544-4313-9799-6ac3ec82b8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea03023b-4ae4-495f-bf84-fecc603523ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "cinder-8149a40b-7645-43e1-b4bb-3f94166265dd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:39 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a (57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a): created successfully Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea03023b-4ae4-495f-bf84-fecc603523ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Flow 'volume_create_manager' (35ec14ce-5607-4c0b-b2bb-f18ad035c209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:39 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6c170720-871f-46c4-a084-a852e0b8a270 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Created volume successfully. Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "cinder-quobyte-8149a40b-7645-43e1-b4bb-3f94166265dd" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "cinder-quobyte-8149a40b-7645-43e1-b4bb-3f94166265dd" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b2977e-7076-4078-a0ca-4e492b1a5f2b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8149a40b-7645-43e1-b4bb-3f94166265dd {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:39 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8149a40b-7645-43e1-b4bb-3f94166265dd Jun 01 09:39:39 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:40 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8149a40b-7645-43e1-b4bb-3f94166265dd" returned: 0 in 0.793s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8149a40b-7645-43e1-b4bb-3f94166265dd {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:40 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8149a40b-7645-43e1-b4bb-3f94166265dd Jun 01 09:39:40 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Flow 'volume_create_manager' (dce7a8ed-d754-42f1-9558-e0e1bcca88c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2aa73b6-eb7c-4c78-83bd-1ea24403d437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2aa73b6-eb7c-4c78-83bd-1ea24403d437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2027292617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f745ab0-e61d-45e9-8fda-5ef105f1393c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef8bf1a4a6c4a4eb326da8c90f872d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:40Z,use_quota=True,user_id='6e13a53d75e14d39b7ee2a06f876ba21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e5b766-6f4e-459c-b70e-17a0f3bfeb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e5b766-6f4e-459c-b70e-17a0f3bfeb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76cfc77-c476-4041-b87c-0cc6882eeda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76cfc77-c476-4041-b87c-0cc6882eeda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f745ab0-e61d-45e9-8fda-5ef105f1393c', 'volume_name': 'volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a5c5dd-5bdd-4b8d-9d34-5cf2e5094e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a5c5dd-5bdd-4b8d-9d34-5cf2e5094e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f0ab28-c24a-43d7-8b16-bad75d9c4bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:40 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume 2f745ab0-e61d-45e9-8fda-5ef105f1393c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c', 'volume_size': 1} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2027292617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f745ab0-e61d-45e9-8fda-5ef105f1393c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef8bf1a4a6c4a4eb326da8c90f872d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:40Z,use_quota=True,user_id='6e13a53d75e14d39b7ee2a06f876ba21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Creating volume 2f745ab0-e61d-45e9-8fda-5ef105f1393c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:40 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:40 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c 1073741824 Jun 01 09:39:40 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Flow 'volume_create_manager' (2e7972ed-1f97-4389-ab24-2ba1f892749c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551d23db-e51d-4902-8457-6544aad84714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551d23db-e51d-4902-8457-6544aad84714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1336204594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2c1d7d-0596-47b6-93e0-384f3137eb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef8bf1a4a6c4a4eb326da8c90f872d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:41Z,use_quota=True,user_id='6e13a53d75e14d39b7ee2a06f876ba21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c4369e-6377-4c2d-aa75-74d4cb46035c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c4369e-6377-4c2d-aa75-74d4cb46035c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bed522e-1971-4df6-b498-b6c2eadf42fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bed522e-1971-4df6-b498-b6c2eadf42fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b2c1d7d-0596-47b6-93e0-384f3137eb2c', 'volume_name': 'volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be90fec8-0b56-49c5-b8d8-f37733bb474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be90fec8-0b56-49c5-b8d8-f37733bb474f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d1dad5-f270-437f-ab81-64b3cf654f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:40 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume 2b2c1d7d-0596-47b6-93e0-384f3137eb2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c', 'volume_size': 1} Jun 01 09:39:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:41 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8149a40b-7645-43e1-b4bb-3f94166265dd" returned: 0 in 1.014s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "cinder-quobyte-8149a40b-7645-43e1-b4bb-3f94166265dd" released by "delete_volume" :: held 1.877s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Flow 'volume_create_manager' (e710770c-cb80-47c5-8419-3abb5a435a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3750e569-295b-49bf-b84d-3ad526739184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3750e569-295b-49bf-b84d-3ad526739184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1749916713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef8bf1a4a6c4a4eb326da8c90f872d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:41Z,use_quota=True,user_id='6e13a53d75e14d39b7ee2a06f876ba21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5c02b1-6b11-4632-a476-9ae6ec5a318d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5c02b1-6b11-4632-a476-9ae6ec5a318d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e801b3d-d7da-4879-9535-8486c2cefa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e801b3d-d7da-4879-9535-8486c2cefa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc', 'volume_name': 'volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5947ded-cfd4-4e76-b50a-995ae14a1b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5947ded-cfd4-4e76-b50a-995ae14a1b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebc9d99-0c69-4793-85ab-7f28306ed70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:41 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume 3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc', 'volume_size': 1} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Created reservations ['b4d356e4-3741-41c5-92dd-5f7f9fa14281', 'e3ff9c2a-ac2f-4a96-8dd5-db590c495133', '48ed6a0b-92a0-4a46-ab1e-73a7f74a7bd3', 'ab474712-3e8b-4f8a-8b91-c6553103b268'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:41 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c 1073741824" returned: 0 in 1.040s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:41 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c Jun 01 09:39:41 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:41 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:41 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Flow 'volume_create_manager' (f6d4048b-eda9-4756-8bcf-27ffbb1864b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4d0dec-e8f1-4276-bdcc-d7503bcfaff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4d0dec-e8f1-4276-bdcc-d7503bcfaff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-991064886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dad74a5-e15e-4245-b20d-42c075212aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef8bf1a4a6c4a4eb326da8c90f872d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:42Z,use_quota=True,user_id='6e13a53d75e14d39b7ee2a06f876ba21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d302c75-3752-4248-b11d-66bd25557b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d302c75-3752-4248-b11d-66bd25557b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6658768-1ec8-47a4-b1b8-acea8508bfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6658768-1ec8-47a4-b1b8-acea8508bfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dad74a5-e15e-4245-b20d-42c075212aeb', 'volume_name': 'volume-9dad74a5-e15e-4245-b20d-42c075212aeb', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bc1d6a-0681-46e6-b2ee-443880b37241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bc1d6a-0681-46e6-b2ee-443880b37241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419fe78e-f8ef-4f18-8cd4-5f0226383ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:42 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume 9dad74a5-e15e-4245-b20d-42c075212aeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dad74a5-e15e-4245-b20d-42c075212aeb', 'volume_size': 1} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Flow 'volume_create_manager' (f0b259a1-7b19-479a-93df-3afeaa94dd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e2fcbc-6d68-4106-9960-2b5afcba4585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=195,cinder:SELECT=144,cinder:INSERT=54,cinder:DELETE=15 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e2fcbc-6d68-4106-9960-2b5afcba4585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1396955746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af325f9-b3d3-43bd-9675-95ef8f0a64c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef8bf1a4a6c4a4eb326da8c90f872d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:43Z,use_quota=True,user_id='6e13a53d75e14d39b7ee2a06f876ba21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e549fce-0ef6-401a-85cc-df43fa1ad605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e549fce-0ef6-401a-85cc-df43fa1ad605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b13c85-82bb-45e7-bd3a-318f74076a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b13c85-82bb-45e7-bd3a-318f74076a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af325f9-b3d3-43bd-9675-95ef8f0a64c8', 'volume_name': 'volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b0bab4-4d46-4b45-8d8b-56870a80e864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b0bab4-4d46-4b45-8d8b-56870a80e864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8299416a-9c5d-4997-9668-c0a955a6c73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:42 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume 8af325f9-b3d3-43bd-9675-95ef8f0a64c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8', 'volume_size': 1} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:42 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.982s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:42 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:42 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Deleted volume successfully. Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c" returned: 0 in 1.028s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] <== create_volume: return (2145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.809s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1336204594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2c1d7d-0596-47b6-93e0-384f3137eb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef8bf1a4a6c4a4eb326da8c90f872d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:41Z,use_quota=True,user_id='6e13a53d75e14d39b7ee2a06f876ba21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Creating volume 2b2c1d7d-0596-47b6-93e0-384f3137eb2c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:42 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f0ab28-c24a-43d7-8b16-bad75d9c4bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1794665-935b-4a58-94cf-c26ca66dba47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:42 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c 1073741824 Jun 01 09:39:42 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-64c571ea-a447-46d8-b570-fea688e58165 tempest-VolumesListAdminTestJSON-1909518785 None] Lock "cinder-8149a40b-7645-43e1-b4bb-3f94166265dd-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:42 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c (2f745ab0-e61d-45e9-8fda-5ef105f1393c): created successfully Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1794665-935b-4a58-94cf-c26ca66dba47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Flow 'volume_create_manager' (dce7a8ed-d754-42f1-9558-e0e1bcca88c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:42 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-05930777-f5dc-4bc9-9e66-8b4ca11ce0fb tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Created volume successfully. Jun 01 09:39:43 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c 1073741824" returned: 0 in 0.983s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:43 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c Jun 01 09:39:43 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:44 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c" returned: 0 in 0.657s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.856s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1749916713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef8bf1a4a6c4a4eb326da8c90f872d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:41Z,use_quota=True,user_id='6e13a53d75e14d39b7ee2a06f876ba21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Creating volume 3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:44 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d1dad5-f270-437f-ab81-64b3cf654f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:44 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc 1073741824 Jun 01 09:39:44 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ddc2a6a-175e-4876-b23a-8cfd59e5efb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:44 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c (2b2c1d7d-0596-47b6-93e0-384f3137eb2c): created successfully Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ddc2a6a-175e-4876-b23a-8cfd59e5efb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Flow 'volume_create_manager' (2e7972ed-1f97-4389-ab24-2ba1f892749c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2ad3bca8-4f26-47e0-9754-35043400a141 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Created volume successfully. Jun 01 09:39:45 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc 1073741824" returned: 0 in 0.828s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:45 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc Jun 01 09:39:45 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:45 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc" returned: 0 in 0.593s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.768s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-991064886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dad74a5-e15e-4245-b20d-42c075212aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef8bf1a4a6c4a4eb326da8c90f872d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:42Z,use_quota=True,user_id='6e13a53d75e14d39b7ee2a06f876ba21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Creating volume 9dad74a5-e15e-4245-b20d-42c075212aeb {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:45 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9dad74a5-e15e-4245-b20d-42c075212aeb 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebc9d99-0c69-4793-85ab-7f28306ed70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:45 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9dad74a5-e15e-4245-b20d-42c075212aeb 1073741824 Jun 01 09:39:45 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282762ae-be70-4749-a324-ab9c185934be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:45 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc (3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc): created successfully Jun 01 09:39:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282762ae-be70-4749-a324-ab9c185934be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Flow 'volume_create_manager' (e710770c-cb80-47c5-8419-3abb5a435a5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2dc54871-a6d3-4b7a-a8bd-7506f10c6768 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Created volume successfully. Jun 01 09:39:46 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9dad74a5-e15e-4245-b20d-42c075212aeb 1073741824" returned: 0 in 0.842s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9dad74a5-e15e-4245-b20d-42c075212aeb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:46 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9dad74a5-e15e-4245-b20d-42c075212aeb Jun 01 09:39:46 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:47 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9dad74a5-e15e-4245-b20d-42c075212aeb" returned: 0 in 0.645s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.770s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1396955746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af325f9-b3d3-43bd-9675-95ef8f0a64c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef8bf1a4a6c4a4eb326da8c90f872d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:43Z,use_quota=True,user_id='6e13a53d75e14d39b7ee2a06f876ba21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Creating volume 8af325f9-b3d3-43bd-9675-95ef8f0a64c8 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:47 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419fe78e-f8ef-4f18-8cd4-5f0226383ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dad74a5-e15e-4245-b20d-42c075212aeb', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:47 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8 1073741824 Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd373668-3415-4171-b1a0-721d19ca2131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:47 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:47 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume volume-9dad74a5-e15e-4245-b20d-42c075212aeb (9dad74a5-e15e-4245-b20d-42c075212aeb): created successfully Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd373668-3415-4171-b1a0-721d19ca2131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Flow 'volume_create_manager' (f6d4048b-eda9-4756-8bcf-27ffbb1864b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-faec198e-79ba-4802-a780-a77f70e87dc1 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Created volume successfully. Jun 01 09:39:48 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8 1073741824" returned: 0 in 0.882s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:48 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8 Jun 01 09:39:48 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:49 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8" returned: 0 in 0.660s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8299416a-9c5d-4997-9668-c0a955a6c73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af2e728-d0a0-43b9-b6d1-757dbb88d0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:49 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Volume volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8 (8af325f9-b3d3-43bd-9675-95ef8f0a64c8): created successfully Jun 01 09:39:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af2e728-d0a0-43b9-b6d1-757dbb88d0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Flow 'volume_create_manager' (f0b259a1-7b19-479a-93df-3afeaa94dd0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c4753cd4-f8fe-40ae-a2cb-290091a88926 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Created volume successfully. Jun 01 09:39:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "cinder-8af325f9-b3d3-43bd-9675-95ef8f0a64c8-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-8af325f9-b3d3-43bd-9675-95ef8f0a64c8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "cinder-quobyte-8af325f9-b3d3-43bd-9675-95ef8f0a64c8" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-quobyte-8af325f9-b3d3-43bd-9675-95ef8f0a64c8" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae31742c-e8d3-464b-8171-8ab381935000]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:49 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8 Jun 01 09:39:49 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:50 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8" returned: 0 in 0.844s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:50 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8 Jun 01 09:39:50 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:51 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8af325f9-b3d3-43bd-9675-95ef8f0a64c8" returned: 0 in 0.636s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-quobyte-8af325f9-b3d3-43bd-9675-95ef8f0a64c8" released by "delete_volume" :: held 1.537s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Created reservations ['a9a46b9e-d025-4135-871b-081dd249c023', '1d7967d6-d513-4cb8-9966-0782f39296ac', 'c4895a7d-95c1-4343-a931-466e10c26f8c', 'e8933aa9-1b6d-4a13-abf2-eba80a87c6e4'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:51 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:51 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Flow 'volume_create_manager' (cfdd0ef7-666b-448d-9e3c-21ad6a20bfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f0f4dd-fd57-4bcf-9d47-e23a74774b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "cinder-9dad74a5-e15e-4245-b20d-42c075212aeb-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f0f4dd-fd57-4bcf-9d47-e23a74774b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-322077699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5748ee-8ddc-4165-a85e-325b205e2218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='706d627a013b4c2f93bee2f87c9decb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:52Z,use_quota=True,user_id='07b3b9c059924d038d9204701ae7dc40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a65d982-6bdd-4a97-9e77-a8f488ee8cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a65d982-6bdd-4a97-9e77-a8f488ee8cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46cc3624-cd6c-40a5-9433-82ff42e10eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46cc3624-cd6c-40a5-9433-82ff42e10eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c5748ee-8ddc-4165-a85e-325b205e2218', 'volume_name': 'volume-6c5748ee-8ddc-4165-a85e-325b205e2218', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3899d15-dbf2-4572-a7b4-d419da9aafc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3899d15-dbf2-4572-a7b4-d419da9aafc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adc22ae-4ee6-4f3c-befb-6cf20adaf333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:51 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Volume 6c5748ee-8ddc-4165-a85e-325b205e2218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c5748ee-8ddc-4165-a85e-325b205e2218', 'volume_size': 1} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-322077699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5748ee-8ddc-4165-a85e-325b205e2218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='706d627a013b4c2f93bee2f87c9decb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:39:52Z,use_quota=True,user_id='07b3b9c059924d038d9204701ae7dc40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Creating volume 6c5748ee-8ddc-4165-a85e-325b205e2218 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:39:51 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-9dad74a5-e15e-4245-b20d-42c075212aeb-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:51 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 1073741824 Jun 01 09:39:51 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "cinder-quobyte-9dad74a5-e15e-4245-b20d-42c075212aeb" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:51 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.614s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-quobyte-9dad74a5-e15e-4245-b20d-42c075212aeb" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Deleted volume successfully. Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b18c7e-1f25-4ad6-9f6b-bae285112b31]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9dad74a5-e15e-4245-b20d-42c075212aeb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4db4a146-1020-4abe-abde-11dfd8ee6ef0 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-8af325f9-b3d3-43bd-9675-95ef8f0a64c8-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:52 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9dad74a5-e15e-4245-b20d-42c075212aeb Jun 01 09:39:52 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:52 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 1073741824" returned: 0 in 0.843s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:52 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9dad74a5-e15e-4245-b20d-42c075212aeb" returned: 0 in 0.741s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9dad74a5-e15e-4245-b20d-42c075212aeb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:52 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9dad74a5-e15e-4245-b20d-42c075212aeb Jun 01 09:39:52 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:52 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 Jun 01 09:39:52 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:53 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9dad74a5-e15e-4245-b20d-42c075212aeb" returned: 0 in 0.602s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-quobyte-9dad74a5-e15e-4245-b20d-42c075212aeb" released by "delete_volume" :: held 1.389s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:53 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218" returned: 0 in 0.597s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adc22ae-4ee6-4f3c-befb-6cf20adaf333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c5748ee-8ddc-4165-a85e-325b205e2218', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe2c352-af04-4ef6-b204-1900be8184e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:39:53 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Volume volume-6c5748ee-8ddc-4165-a85e-325b205e2218 (6c5748ee-8ddc-4165-a85e-325b205e2218): created successfully Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe2c352-af04-4ef6-b204-1900be8184e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Flow 'volume_create_manager' (cfdd0ef7-666b-448d-9e3c-21ad6a20bfba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:39:53 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-14bcd7eb-5aa5-44fd-a86e-6a9705de6178 tempest-VolumesDeleteCascade-1366606570 None] Created volume successfully. Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Created reservations ['db6fdd1e-dd2b-417f-8848-61e982dfc9ae', 'ae1b4f7c-d5b9-4c50-9882-d46762157d6e', '125d7e4d-8aca-4d12-926f-4599266c3c14', '5d065e75-0b2a-4733-97c4-54e705a7f778'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:53 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:53 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "cinder-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] Creating offline snapshot c2553522-9d66-4125-93be-005a1dfe012a of volume 6c5748ee-8ddc-4165-a85e-325b205e2218 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0c5cef-aa59-4d8c-8191-63d4534f551a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:54 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.670s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "cinder-quobyte-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Deleted volume successfully. Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-quobyte-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c02d4ed9-36cf-4fe4-a984-afa1f188f5ee tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-9dad74a5-e15e-4245-b20d-42c075212aeb-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fead00f4-7778-440b-acc4-53fccb2cea91]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:54 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 Jun 01 09:39:54 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:54 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc Jun 01 09:39:54 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:54 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218" returned: 0 in 0.761s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:54 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a 1G Jun 01 09:39:54 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:54 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc" returned: 0 in 0.715s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:54 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc Jun 01 09:39:54 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:55 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc" returned: 0 in 0.864s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-quobyte-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc" released by "delete_volume" :: held 1.630s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:55 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Created reservations ['fbbfbf3b-59ab-4f61-ad53-adc1eafe6fbd', '9ecf1305-80c8-4bf8-b073-9d5db384bb0e', '23767bb5-207d-4dbd-bce3-4b1e8fb66c85', '9b6f6714-3864-4569-a932-7af1122a009d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:56 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:56 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:56 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a 1G" returned: 0 in 1.279s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5748ee-8ddc-4165-a85e-325b205e2218 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:56 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5748ee-8ddc-4165-a85e-325b205e2218 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a Jun 01 09:39:56 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "cinder-2b2c1d7d-0596-47b6-93e0-384f3137eb2c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-2b2c1d7d-0596-47b6-93e0-384f3137eb2c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "cinder-quobyte-2b2c1d7d-0596-47b6-93e0-384f3137eb2c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-quobyte-2b2c1d7d-0596-47b6-93e0-384f3137eb2c" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02dc768-d1fd-4d6e-9b2e-9fd9ae646345]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:56 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c Jun 01 09:39:56 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:56 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.827s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:56 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Deleted volume successfully. Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dddbedb5-be20-4ff1-a7de-c3a36489e888 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-3a5880d5-0f35-44c0-81f3-dc9b5e1f7bfc-delete_volume" released by "delete_volume" :: held 2.834s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:56 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5748ee-8ddc-4165-a85e-325b205e2218 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a" returned: 0 in 0.836s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:56 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a is being set with open permissions: ugo+rw Jun 01 09:39:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:56 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a Jun 01 09:39:56 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:57 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c" returned: 0 in 0.847s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:57 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c Jun 01 09:39:57 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:57 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a" returned: 0 in 0.881s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:57 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.info Jun 01 09:39:57 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:58 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b2c1d7d-0596-47b6-93e0-384f3137eb2c" returned: 0 in 0.662s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-quobyte-2b2c1d7d-0596-47b6-93e0-384f3137eb2c" released by "delete_volume" :: held 1.568s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Created reservations ['1316d069-8a2c-4d4a-848e-984097f4af14', '6b5a33e8-f4f1-45f6-aa7b-905359c36ff2', '3443977b-0751-4b19-a22f-bcc4a8b213ae', '24301216-f25d-43c8-9761-8234f3281a73'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:58 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:39:58 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:58 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.info" returned: 0 in 0.654s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:58 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.info is being set with open permissions: ugo+rw Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:58 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.info Jun 01 09:39:58 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "cinder-2f745ab0-e61d-45e9-8fda-5ef105f1393c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-2f745ab0-e61d-45e9-8fda-5ef105f1393c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "cinder-quobyte-2f745ab0-e61d-45e9-8fda-5ef105f1393c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-quobyte-2f745ab0-e61d-45e9-8fda-5ef105f1393c" acquired by "delete_volume" :: waited 0.037s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55ac4cc-ce3d-498f-a47f-982bc555509e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:39:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:59 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c Jun 01 09:39:59 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:39:59 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.044s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:39:59 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Deleted volume successfully. Jun 01 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-592bad63-107e-4190-b10d-cc96b3351c13 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-2b2c1d7d-0596-47b6-93e0-384f3137eb2c-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:39:59 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.info" returned: 0 in 1.042s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.584s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:39:59 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-09b8aded-afa9-4264-a3df-c0c164950aed tempest-VolumesDeleteCascade-1366606570 None] Create snapshot completed successfully Jun 01 09:39:59 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Jun 01 09:39:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c" returned: 0 in 0.858s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:39:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:39:59 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c Jun 01 09:39:59 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:00 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2f745ab0-e61d-45e9-8fda-5ef105f1393c" returned: 0 in 0.734s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-quobyte-2f745ab0-e61d-45e9-8fda-5ef105f1393c" released by "delete_volume" :: held 1.680s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=138,cinder:UPDATE=202,cinder:DELETE=21,cinder:INSERT=40 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Created reservations ['5411a876-7505-48e0-beab-2ef34d056a43', 'c6a3703f-1f35-46f8-9eb0-7e0a71092909', 'e26e65cc-2cbb-4c86-86a2-bb90b0142aa7', 'eff600e7-a484-479a-9fde-b6eda3b2254a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] Creating offline snapshot c5b0455f-e3fb-4767-9c34-120393ebebf9 of volume 6c5748ee-8ddc-4165-a85e-325b205e2218 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93722bc-6dd3-4981-9b6e-3da81a43fdd8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:00 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:40:00 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:00 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a Jun 01 09:40:00 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "cinder-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "cinder-quobyte-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-quobyte-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:01 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[952b86d7-b3f5-44e8-9cb7-1a00b311f31e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:01 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a Jun 01 09:40:01 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:01 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.780s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:01 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:40:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Deleted volume successfully. Jun 01 09:40:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b2be684-1e40-4759-a5ff-f4bd821e0d8e tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-2f745ab0-e61d-45e9-8fda-5ef105f1393c-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:01 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a" returned: 0 in 1.003s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c5748ee-8ddc-4165-a85e-325b205e2218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:40:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:01 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 1G Jun 01 09:40:01 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:02 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a" returned: 0 in 0.959s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:02 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a Jun 01 09:40:02 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:02 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 1G" returned: 0 in 0.855s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:02 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 Jun 01 09:40:02 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:02 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a" returned: 0 in 0.708s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-quobyte-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a" released by "delete_volume" :: held 1.722s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:02 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Created reservations ['b5ad0ec0-bbd7-4c40-ab15-5e8899b731ac', '5d2b8f3b-7286-4822-a7bc-962359c72a01', 'e958fe07-9666-4958-8a6f-094585c1abbd', '23701757-6455-4392-94e7-e432fe9547e3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:02 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:40:02 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:03 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9" returned: 0 in 0.647s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:03 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 is being set with open permissions: ugo+rw Jun 01 09:40:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:03 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 Jun 01 09:40:03 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:03 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.671s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:03 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:40:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Deleted volume successfully. Jun 01 09:40:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d8c2b2c6-0655-43b9-91c4-90a28adb7f41 tempest-CreateVolumesFromSourceVolumeTest-992028143 None] Lock "cinder-57e7ed09-b7cb-4dd5-bd11-1c6ff643fc7a-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:03 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9" returned: 0 in 0.692s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.298s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-67eda66d-a7eb-43dc-814c-660c62bb340d tempest-VolumesDeleteCascade-1366606570 None] Create snapshot completed successfully Jun 01 09:40:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-6c5748ee-8ddc-4165-a85e-325b205e2218-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-6c5748ee-8ddc-4165-a85e-325b205e2218-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Performing cascade delete. {{(pid=86649) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 01 09:40:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-c2553522-9d66-4125-93be-005a1dfe012a-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-c2553522-9d66-4125-93be-005a1dfe012a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-quobyte-6c5748ee-8ddc-4165-a85e-325b205e2218" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-6c5748ee-8ddc-4165-a85e-325b205e2218" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-quobyte-c2553522-9d66-4125-93be-005a1dfe012a" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-c2553522-9d66-4125-93be-005a1dfe012a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Deleting offline snapshot c2553522-9d66-4125-93be-005a1dfe012a of volume 6c5748ee-8ddc-4165-a85e-325b205e2218 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:40:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] snapshot_file for this snap is: volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:40:05 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[55663a96-b008-4807-825b-25e58297b062]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:05 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a Jun 01 09:40:05 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:05 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a" returned: 0 in 0.767s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c5748ee-8ddc-4165-a85e-325b205e2218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:40:05 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9f284a-8bf2-45df-a1ef-c02a276b10ba]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:06 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 Jun 01 09:40:06 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Flow 'volume_create_manager' (2c46319d-2a67-4506-871e-48d5c3517f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5942c18f-6046-4252-b468-aee8f6bd3d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5942c18f-6046-4252-b468-aee8f6bd3d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3dea09-55af-4cef-aafd-2563f3c12839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73a4570414c4e2cbda41b0b10ff325d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:06Z,use_quota=True,user_id='fe2d25af9eb84aaf81138279d43165ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bcda24-6648-4324-b4cb-28cf5d2ab40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bcda24-6648-4324-b4cb-28cf5d2ab40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f989d4-2fdc-4032-8686-ff9b3cad5424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f989d4-2fdc-4032-8686-ff9b3cad5424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3dea09-55af-4cef-aafd-2563f3c12839', 'volume_name': 'volume-6b3dea09-55af-4cef-aafd-2563f3c12839', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41684642-31f1-4bc2-8cc4-600316101dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41684642-31f1-4bc2-8cc4-600316101dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ed9c47-ecdf-4153-b395-c6c24e0a04e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:06 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Volume 6b3dea09-55af-4cef-aafd-2563f3c12839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3dea09-55af-4cef-aafd-2563f3c12839', 'volume_size': 1} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3dea09-55af-4cef-aafd-2563f3c12839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73a4570414c4e2cbda41b0b10ff325d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:06Z,use_quota=True,user_id='fe2d25af9eb84aaf81138279d43165ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Creating volume 6b3dea09-55af-4cef-aafd-2563f3c12839 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:40:06 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b3dea09-55af-4cef-aafd-2563f3c12839 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:06 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b3dea09-55af-4cef-aafd-2563f3c12839 1073741824 Jun 01 09:40:06 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:06 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218" returned: 0 in 0.842s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51fde96-5307-4b14-91e4-ffe02a8a824d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:06 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 Jun 01 09:40:06 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:07 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b3dea09-55af-4cef-aafd-2563f3c12839 1073741824" returned: 0 in 0.851s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b3dea09-55af-4cef-aafd-2563f3c12839 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:07 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b3dea09-55af-4cef-aafd-2563f3c12839 Jun 01 09:40:07 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:07 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9" returned: 0 in 0.785s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c5748ee-8ddc-4165-a85e-325b205e2218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:40:07 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f6c23c-9d7b-44d7-b847-1f3a56401193]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:07 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a Jun 01 09:40:07 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:07 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b3dea09-55af-4cef-aafd-2563f3c12839" returned: 0 in 0.618s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:40:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ed9c47-ecdf-4153-b395-c6c24e0a04e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3dea09-55af-4cef-aafd-2563f3c12839', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ade01bd-6a67-42e4-b5b0-d17fc7a156f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:08 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Volume volume-6b3dea09-55af-4cef-aafd-2563f3c12839 (6b3dea09-55af-4cef-aafd-2563f3c12839): created successfully Jun 01 09:40:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ade01bd-6a67-42e4-b5b0-d17fc7a156f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Flow 'volume_create_manager' (2c46319d-2a67-4506-871e-48d5c3517f7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:08 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0b2c4e81-0b0b-423e-96fd-96aeaa9c82ea tempest-CinderUnicodeTest-288235145 None] Created volume successfully. Jun 01 09:40:08 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a" returned: 0 in 0.756s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c5748ee-8ddc-4165-a85e-325b205e2218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:40:08 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27adc12-211b-4ceb-8b61-1f593703c8f1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:08 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 Jun 01 09:40:08 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Flow 'volume_create_manager' (ae557ef2-5699-41ad-9579-599e962af841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a690e5a2-3a4f-4457-a690-28612b67c16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a690e5a2-3a4f-4457-a690-28612b67c16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-627199736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2609544-8c8c-47ed-b04b-7e468bd4922b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73a4570414c4e2cbda41b0b10ff325d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:09Z,use_quota=True,user_id='fe2d25af9eb84aaf81138279d43165ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53bce4d-8f64-4c53-9d6c-d84d6ca1154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53bce4d-8f64-4c53-9d6c-d84d6ca1154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b4d289-8a81-4889-8a75-611476cb1c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b4d289-8a81-4889-8a75-611476cb1c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2609544-8c8c-47ed-b04b-7e468bd4922b', 'volume_name': 'volume-b2609544-8c8c-47ed-b04b-7e468bd4922b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59776e21-572a-4a5e-8f69-31928144d8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59776e21-572a-4a5e-8f69-31928144d8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02f60de-108b-4ac5-bc59-7ef412095028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:09 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Volume b2609544-8c8c-47ed-b04b-7e468bd4922b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2609544-8c8c-47ed-b04b-7e468bd4922b', 'volume_size': 1} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-627199736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2609544-8c8c-47ed-b04b-7e468bd4922b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73a4570414c4e2cbda41b0b10ff325d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:09Z,use_quota=True,user_id='fe2d25af9eb84aaf81138279d43165ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Creating volume b2609544-8c8c-47ed-b04b-7e468bd4922b {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:40:09 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:09 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218" returned: 0 in 0.857s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:09 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b 1073741824 Jun 01 09:40:09 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:09 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a Jun 01 09:40:09 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:09 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a" returned: 0 in 0.731s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:09 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b 1073741824" returned: 0 in 0.762s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:09 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a Jun 01 09:40:09 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:10 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b Jun 01 09:40:10 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:10 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c2553522-9d66-4125-93be-005a1dfe012a" returned: 0 in 0.608s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5748ee-8ddc-4165-a85e-325b205e2218 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 -F qcow2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:10 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b" returned: 0 in 0.574s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:40:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:10 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5748ee-8ddc-4165-a85e-325b205e2218 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 -F qcow2 Jun 01 09:40:10 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02f60de-108b-4ac5-bc59-7ef412095028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2609544-8c8c-47ed-b04b-7e468bd4922b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e52e3b-0030-4964-80e5-019560b73302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:10 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Volume volume-b2609544-8c8c-47ed-b04b-7e468bd4922b (b2609544-8c8c-47ed-b04b-7e468bd4922b): created successfully Jun 01 09:40:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e52e3b-0030-4964-80e5-019560b73302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Flow 'volume_create_manager' (ae557ef2-5699-41ad-9579-599e962af841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e096e901-df2a-42e6-9c74-8036ab3b22d9 tempest-CinderUnicodeTest-288235145 None] Created volume successfully. Jun 01 09:40:11 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5748ee-8ddc-4165-a85e-325b205e2218 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 -F qcow2" returned: 0 in 0.620s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-c2553522-9d66-4125-93be-005a1dfe012a" released by "_delete_snapshot" :: held 6.141s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-6c5748ee-8ddc-4165-a85e-325b205e2218" released by "delete_snapshot" :: held 6.165s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Created reservations ['95793f58-db07-4677-b8f2-2d1cb3938c23', 'c694cd5e-48f0-4548-ad8d-468b3452e04e', 'c51e7924-e9a1-43bb-8fef-406b70cc6bbf', '79ad4072-438e-44fe-af24-c9a6c1801386'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Delete snapshot completed successfully. Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-c2553522-9d66-4125-93be-005a1dfe012a-delete_snapshot" released by "delete_snapshot" :: held 6.310s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-c5b0455f-e3fb-4767-9c34-120393ebebf9-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-c5b0455f-e3fb-4767-9c34-120393ebebf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-quobyte-6c5748ee-8ddc-4165-a85e-325b205e2218" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-6c5748ee-8ddc-4165-a85e-325b205e2218" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-quobyte-c5b0455f-e3fb-4767-9c34-120393ebebf9" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-c5b0455f-e3fb-4767-9c34-120393ebebf9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Deleting offline snapshot c5b0455f-e3fb-4767-9c34-120393ebebf9 of volume 6c5748ee-8ddc-4165-a85e-325b205e2218 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] snapshot_file for this snap is: volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f1dae7-7c62-4be8-be78-65b2742db8e2]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] Creating offline snapshot b19efe8b-1897-418a-aa59-3a5f302c3089 of volume b2609544-8c8c-47ed-b04b-7e468bd4922b {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e317b331-1848-4236-bdb0-410d3565fd32]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:11 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 Jun 01 09:40:11 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:11 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b Jun 01 09:40:11 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:12 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9" returned: 0 in 0.744s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c5748ee-8ddc-4165-a85e-325b205e2218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:40:12 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29109e4-87ba-4ce0-8e12-d48c5319aab7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:12 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b" returned: 0 in 0.704s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:12 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 1G Jun 01 09:40:12 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:12 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 Jun 01 09:40:12 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:13 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218" returned: 0 in 0.792s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:13 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 1G" returned: 0 in 0.794s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2609544-8c8c-47ed-b04b-7e468bd4922b -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:13 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 Jun 01 09:40:13 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:13 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2609544-8c8c-47ed-b04b-7e468bd4922b -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 Jun 01 09:40:13 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:13 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2609544-8c8c-47ed-b04b-7e468bd4922b -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089" returned: 0 in 0.622s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:13 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 is being set with open permissions: ugo+rw Jun 01 09:40:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:13 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 Jun 01 09:40:13 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:13 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9" returned: 0 in 0.700s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:13 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9 Jun 01 09:40:13 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:14 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089" returned: 0 in 0.569s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:14 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.info Jun 01 09:40:14 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:14 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218.c5b0455f-e3fb-4767-9c34-120393ebebf9" returned: 0 in 0.595s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-c5b0455f-e3fb-4767-9c34-120393ebebf9" released by "_delete_snapshot" :: held 2.962s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-6c5748ee-8ddc-4165-a85e-325b205e2218" released by "delete_snapshot" :: held 2.988s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:14 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Created reservations ['9cc8f4a0-28ab-4b54-8881-ed235f89c766', 'd8856734-dbf2-4d1e-80a4-c43767030a60', '1173f5da-550b-4403-814b-d7bf42144375', '5fe43a27-ba09-4b08-99e7-4ce57c501eda'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Delete snapshot completed successfully. Jun 01 09:40:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-c5b0455f-e3fb-4767-9c34-120393ebebf9-delete_snapshot" released by "delete_snapshot" :: held 3.142s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Snapshots deleted, issuing volume delete {{(pid=86649) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 01 09:40:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-quobyte-6c5748ee-8ddc-4165-a85e-325b205e2218" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-6c5748ee-8ddc-4165-a85e-325b205e2218" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:14 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54e43e0-0b08-4c76-b3da-40fe6961431e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:14 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 Jun 01 09:40:14 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:14 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.info" returned: 0 in 0.583s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:14 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.info is being set with open permissions: ugo+rw Jun 01 09:40:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:14 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.info Jun 01 09:40:14 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:15 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218" returned: 0 in 0.702s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:15 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218 Jun 01 09:40:15 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:15 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.info" returned: 0 in 0.563s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.935s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-51ee36f1-182b-45ae-9407-5ba45db1bf48 tempest-CinderUnicodeTest-288235145 None] Create snapshot completed successfully Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Acquiring lock "cinder-b19efe8b-1897-418a-aa59-3a5f302c3089-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Lock "cinder-b19efe8b-1897-418a-aa59-3a5f302c3089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Acquiring lock "cinder-quobyte-b2609544-8c8c-47ed-b04b-7e468bd4922b" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Lock "cinder-quobyte-b2609544-8c8c-47ed-b04b-7e468bd4922b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Acquiring lock "cinder-quobyte-b19efe8b-1897-418a-aa59-3a5f302c3089" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Lock "cinder-quobyte-b19efe8b-1897-418a-aa59-3a5f302c3089" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Deleting offline snapshot b19efe8b-1897-418a-aa59-3a5f302c3089 of volume b2609544-8c8c-47ed-b04b-7e468bd4922b {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] snapshot_file for this snap is: volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[989454a8-3dc7-4e30-91f9-7fde046030da]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:15 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6c5748ee-8ddc-4165-a85e-325b205e2218" returned: 0 in 0.614s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-6c5748ee-8ddc-4165-a85e-325b205e2218" released by "delete_volume" :: held 1.372s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Created reservations ['2c6e9ec7-bcaa-45b7-a0c2-f193cf2dbb8d', 'f3f91c67-b3fd-43ec-9bf6-34a86c87a2d5', 'da4da4d9-70ea-4fa9-82cb-b968991af472', '76e22e77-83d3-4510-8658-d1a2ecefa181'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:15 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 Jun 01 09:40:15 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:16 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:40:16 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:16 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089" returned: 0 in 0.721s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2609544-8c8c-47ed-b04b-7e468bd4922b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:40:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9993b637-32d3-466b-9496-66778607fb53]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:16 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.595s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:16 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:40:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Deleted volume successfully. Jun 01 09:40:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cdaaca6e-0d56-4588-92ee-a6cb8895e1bd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-6c5748ee-8ddc-4165-a85e-325b205e2218-delete_volume" released by "delete_volume" :: held 11.676s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:16 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b Jun 01 09:40:16 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:17 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b" returned: 0 in 0.756s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:17 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 Jun 01 09:40:17 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Flow 'volume_create_manager' (5220f295-f5b6-4b96-a8b4-c5e6fad2b906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32885d26-ad99-4a9f-a6bd-759139f2aac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32885d26-ad99-4a9f-a6bd-759139f2aac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1613408573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ded766-f2f1-451b-9271-6f70846a7330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='706d627a013b4c2f93bee2f87c9decb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:17Z,use_quota=True,user_id='07b3b9c059924d038d9204701ae7dc40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161fe315-e385-42a9-93d0-98b5da208343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161fe315-e385-42a9-93d0-98b5da208343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed6ae7e-fbb9-4a06-a50d-69ba9567942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed6ae7e-fbb9-4a06-a50d-69ba9567942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ded766-f2f1-451b-9271-6f70846a7330', 'volume_name': 'volume-64ded766-f2f1-451b-9271-6f70846a7330', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275c0000-aa1e-4c4b-a66c-53a54fdf28c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275c0000-aa1e-4c4b-a66c-53a54fdf28c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac754bfa-5c2d-4d9e-891f-aefbf98afeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:17 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Volume 64ded766-f2f1-451b-9271-6f70846a7330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ded766-f2f1-451b-9271-6f70846a7330', 'volume_size': 1} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1613408573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ded766-f2f1-451b-9271-6f70846a7330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='706d627a013b4c2f93bee2f87c9decb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:17Z,use_quota=True,user_id='07b3b9c059924d038d9204701ae7dc40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Creating volume 64ded766-f2f1-451b-9271-6f70846a7330 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:40:17 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:40:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:17 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 1073741824 Jun 01 09:40:17 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:18 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089" returned: 0 in 0.743s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:18 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089 Jun 01 09:40:18 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:18 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 1073741824" returned: 0 in 0.848s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:18 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 Jun 01 09:40:18 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:18 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b.b19efe8b-1897-418a-aa59-3a5f302c3089" returned: 0 in 0.628s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Lock "cinder-quobyte-b19efe8b-1897-418a-aa59-3a5f302c3089" released by "_delete_snapshot" :: held 2.969s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Lock "cinder-quobyte-b2609544-8c8c-47ed-b04b-7e468bd4922b" released by "delete_snapshot" :: held 2.995s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:18 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Created reservations ['e4e5b2d3-71e9-4393-a741-65e31e7203cd', '756946be-a8f9-42ab-aeb2-0858e5bad449', '659f86dd-57b4-47ae-b55c-f6a97ba7fa41', '0862fccb-6ad3-4610-9898-454f3c7138ab'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Delete snapshot completed successfully. Jun 01 09:40:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4327e470-e0c6-4e4e-8110-3ebac16733b7 tempest-CinderUnicodeTest-288235145 None] Lock "cinder-b19efe8b-1897-418a-aa59-3a5f302c3089-delete_snapshot" released by "delete_snapshot" :: held 3.151s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Acquiring lock "cinder-b2609544-8c8c-47ed-b04b-7e468bd4922b-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Lock "cinder-b2609544-8c8c-47ed-b04b-7e468bd4922b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Acquiring lock "cinder-quobyte-b2609544-8c8c-47ed-b04b-7e468bd4922b" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Lock "cinder-quobyte-b2609544-8c8c-47ed-b04b-7e468bd4922b" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fd3e95-a778-4691-a8a7-49345bd896b1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:19 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330" returned: 0 in 0.673s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:19 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b Jun 01 09:40:19 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac754bfa-5c2d-4d9e-891f-aefbf98afeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ded766-f2f1-451b-9271-6f70846a7330', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a879445a-5649-4348-a031-49f53eb6d846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:19 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Volume volume-64ded766-f2f1-451b-9271-6f70846a7330 (64ded766-f2f1-451b-9271-6f70846a7330): created successfully Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a879445a-5649-4348-a031-49f53eb6d846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Flow 'volume_create_manager' (5220f295-f5b6-4b96-a8b4-c5e6fad2b906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-93acc8cc-ec44-4f28-b83c-de226899d453 tempest-VolumesDeleteCascade-1366606570 None] Created volume successfully. Jun 01 09:40:19 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b" returned: 0 in 0.739s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:19 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] Creating offline snapshot 98a84428-0d36-46d8-892d-a4adbe6890a0 of volume 64ded766-f2f1-451b-9271-6f70846a7330 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:40:19 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e58a5d3-9851-4340-8f48-d5cb7f512e73]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:19 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 Jun 01 09:40:19 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:20 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b2609544-8c8c-47ed-b04b-7e468bd4922b" returned: 0 in 0.692s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Lock "cinder-quobyte-b2609544-8c8c-47ed-b04b-7e468bd4922b" released by "delete_volume" :: held 1.516s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Created reservations ['6a8d1b3f-e1b1-4d05-93d7-89dd2f6b99d0', 'dcc00468-a49c-477e-80cf-f7d205f9f773', 'a4d51a46-2d05-497a-bd89-13c0be2655e4', 'd3611228-dd51-46c6-90de-981ae1b33193'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:20 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330" returned: 0 in 0.887s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:20 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:40:20 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:40:20 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 1G Jun 01 09:40:20 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Flow 'volume_create_manager' (81fbe74b-3d7c-4ee4-8969-4c0c27af6628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6623ab34-a180-4814-b6a8-a756d09cf71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6623ab34-a180-4814-b6a8-a756d09cf71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-411341639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43454e8-597d-4845-93da-b42ef10c41df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95edc71b7d5545dd9dfe66003ad99a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:21Z,use_quota=True,user_id='4556f162e5ee4c4280099d79ffb03334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d0a770-f681-47f8-86f2-eedce4b5b289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d0a770-f681-47f8-86f2-eedce4b5b289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d695b5-73a7-41a2-b1eb-9f691b394428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d695b5-73a7-41a2-b1eb-9f691b394428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd43454e8-597d-4845-93da-b42ef10c41df', 'volume_name': 'volume-d43454e8-597d-4845-93da-b42ef10c41df', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19e8016-0143-4f34-81fa-80d988593fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19e8016-0143-4f34-81fa-80d988593fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a09f9f-7c0e-4619-85be-89099c149650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:20 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Volume d43454e8-597d-4845-93da-b42ef10c41df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d43454e8-597d-4845-93da-b42ef10c41df', 'volume_size': 1} Jun 01 09:40:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Acquiring lock "cinder-6b3dea09-55af-4cef-aafd-2563f3c12839-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Lock "cinder-6b3dea09-55af-4cef-aafd-2563f3c12839-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Acquiring lock "cinder-quobyte-6b3dea09-55af-4cef-aafd-2563f3c12839" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Lock "cinder-quobyte-6b3dea09-55af-4cef-aafd-2563f3c12839" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:21 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf6cb55-fa15-4f40-b296-88eb5c5bb94c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b3dea09-55af-4cef-aafd-2563f3c12839 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:21 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b3dea09-55af-4cef-aafd-2563f3c12839 Jun 01 09:40:21 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:21 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.727s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:21 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:40:21 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Deleted volume successfully. Jun 01 09:40:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c0c4ab22-212d-470c-97d4-4efc0a0cc019 tempest-CinderUnicodeTest-288235145 None] Lock "cinder-b2609544-8c8c-47ed-b04b-7e468bd4922b-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:21 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 1G" returned: 0 in 0.855s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64ded766-f2f1-451b-9271-6f70846a7330 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:21 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64ded766-f2f1-451b-9271-6f70846a7330 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 Jun 01 09:40:21 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:22 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b3dea09-55af-4cef-aafd-2563f3c12839" returned: 0 in 0.734s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b3dea09-55af-4cef-aafd-2563f3c12839 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:22 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b3dea09-55af-4cef-aafd-2563f3c12839 Jun 01 09:40:22 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:22 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64ded766-f2f1-451b-9271-6f70846a7330 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0" returned: 0 in 0.693s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:22 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 is being set with open permissions: ugo+rw Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:22 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 Jun 01 09:40:22 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:22 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b3dea09-55af-4cef-aafd-2563f3c12839" returned: 0 in 0.633s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Lock "cinder-quobyte-6b3dea09-55af-4cef-aafd-2563f3c12839" released by "delete_volume" :: held 1.427s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Created reservations ['7f6809bf-cee4-41bc-87da-a494a3bded8f', '72adb001-e5b1-44ef-ba52-b25d8fbf5ae2', 'db552bb9-fbb3-4468-b2f0-b6dbfc7d77a0', 'f249bc6b-253f-4cd4-b9ae-ec0875af3f7d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:22 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:40:22 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:22 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0" returned: 0 in 0.624s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:22 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.info Jun 01 09:40:22 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:23 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.632s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:23 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:40:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Deleted volume successfully. Jun 01 09:40:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7bd81136-bb85-4557-8c92-2a72d2322dc9 tempest-CinderUnicodeTest-288235145 None] Lock "cinder-6b3dea09-55af-4cef-aafd-2563f3c12839-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:23 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.info" returned: 0 in 0.610s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:23 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.info is being set with open permissions: ugo+rw Jun 01 09:40:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:23 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.info Jun 01 09:40:23 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:24 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.info" returned: 0 in 0.624s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.386s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.339s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-411341639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43454e8-597d-4845-93da-b42ef10c41df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95edc71b7d5545dd9dfe66003ad99a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:21Z,use_quota=True,user_id='4556f162e5ee4c4280099d79ffb03334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:40:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Creating volume d43454e8-597d-4845-93da-b42ef10c41df {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:40:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:40:24 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:40:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:24 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df 1073741824 Jun 01 09:40:24 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:24 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-046c83f9-bdeb-4f7f-a570-550245f2ac56 tempest-VolumesDeleteCascade-1366606570 None] Create snapshot completed successfully Jun 01 09:40:25 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df 1073741824" returned: 0 in 0.836s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:25 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df Jun 01 09:40:25 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Flow 'volume_create_manager' (7a439939-88ac-42ed-936e-90d23a311211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1d08f9-8fd1-499b-a090-e0a513493e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1d08f9-8fd1-499b-a090-e0a513493e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-571179492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ad59050-aed5-4d5b-8413-6883516d7742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='706d627a013b4c2f93bee2f87c9decb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98a84428-0d36-46d8-892d-a4adbe6890a0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:25Z,use_quota=True,user_id='07b3b9c059924d038d9204701ae7dc40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54406044-5e2b-4a1d-82bf-f56757e95a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54406044-5e2b-4a1d-82bf-f56757e95a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8b3891-dc7b-4919-b3bb-da9d2556d346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8b3891-dc7b-4919-b3bb-da9d2556d346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ad59050-aed5-4d5b-8413-6883516d7742', 'volume_name': 'volume-6ad59050-aed5-4d5b-8413-6883516d7742', 'volume_size': 1, 'snapshot_id': '98a84428-0d36-46d8-892d-a4adbe6890a0'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd24aa07-6d54-4fe7-a111-8d391b9d1f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd24aa07-6d54-4fe7-a111-8d391b9d1f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece1479e-cc34-48fe-b096-f06d23be815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:25 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Volume 6ad59050-aed5-4d5b-8413-6883516d7742: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ad59050-aed5-4d5b-8413-6883516d7742', 'volume_size': 1, 'snapshot_id': '98a84428-0d36-46d8-892d-a4adbe6890a0'} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:25 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df" returned: 0 in 0.664s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.121s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-quobyte-98a84428-0d36-46d8-892d-a4adbe6890a0-6ad59050-aed5-4d5b-8413-6883516d7742" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a09f9f-7c0e-4619-85be-89099c149650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d43454e8-597d-4845-93da-b42ef10c41df', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28650366-5d8c-4a4e-accb-1e3e235a1696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-98a84428-0d36-46d8-892d-a4adbe6890a0-6ad59050-aed5-4d5b-8413-6883516d7742" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Creating volume 6ad59050-aed5-4d5b-8413-6883516d7742 from snapshot 98a84428-0d36-46d8-892d-a4adbe6890a0 {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-quobyte-6ad59050-aed5-4d5b-8413-6883516d7742" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:25 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Volume volume-d43454e8-597d-4845-93da-b42ef10c41df (d43454e8-597d-4845-93da-b42ef10c41df): created successfully Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28650366-5d8c-4a4e-accb-1e3e235a1696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Flow 'volume_create_manager' (81fbe74b-3d7c-4ee4-8969-4c0c27af6628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-6ad59050-aed5-4d5b-8413-6883516d7742" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] snapshot: 98a84428-0d36-46d8-892d-a4adbe6890a0, volume: 6ad59050-aed5-4d5b-8413-6883516d7742, {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 01 09:40:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1f37fdff-7781-425f-abd8-682f3c6b58cc tempest-AttachVolumeNegativeTest-312487544 None] Created volume successfully. Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[44767bdc-fba6-41d8-af39-e0b309c31b09]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:26 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 Jun 01 09:40:26 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:26 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0" returned: 0 in 0.768s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64ded766-f2f1-451b-9271-6f70846a7330(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:40:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 01 09:40:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 01 09:40:26 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[734553a2-f9b1-4e5e-8607-598ed4545b20]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:26 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 Jun 01 09:40:26 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:27 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330" returned: 0 in 0.740s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:27 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Path /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 01 09:40:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:27 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742 Jun 01 09:40:27 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-c8786f9a-461c-45d8-9f11-46754e9ff1e9 req-32e0e6d6-0120-4d28-9f76-e3c272c04206 tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:32 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742" returned: 0 in 5.235s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[880d03cd-76f1-4b10-b116-a6e24ae183fe]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:32 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 Jun 01 09:40:32 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:33 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330" returned: 0 in 0.914s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:33 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Image conversion details: src /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:40:33 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Converted 1024.00 MB image at 195.55 MB/s Jun 01 09:40:33 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742 is being set with open permissions: ugo+rw Jun 01 09:40:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:33 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742 Jun 01 09:40:33 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:34 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742" returned: 0 in 0.602s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-6ad59050-aed5-4d5b-8413-6883516d7742" released by "_copy_volume_from_snapshot" :: held 8.375s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-98a84428-0d36-46d8-892d-a4adbe6890a0-6ad59050-aed5-4d5b-8413-6883516d7742" released by "_create_volume_from_snapshot" :: held 8.426s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.470s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-c8786f9a-461c-45d8-9f11-46754e9ff1e9 req-32e0e6d6-0120-4d28-9f76-e3c272c04206 tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.605s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[276ceb6b-e512-4a48-b051-65ef74417034]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-c8786f9a-461c-45d8-9f11-46754e9ff1e9 req-32e0e6d6-0120-4d28-9f76-e3c272c04206 tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece1479e-cc34-48fe-b096-f06d23be815a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ad59050-aed5-4d5b-8413-6883516d7742', 'volume_size': 1, 'snapshot_id': '98a84428-0d36-46d8-892d-a4adbe6890a0'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514740b7-72a9-4f2d-aa10-c9cbf1d4b662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:34 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Volume volume-6ad59050-aed5-4d5b-8413-6883516d7742 (6ad59050-aed5-4d5b-8413-6883516d7742): created successfully Jun 01 09:40:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514740b7-72a9-4f2d-aa10-c9cbf1d4b662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Flow 'volume_create_manager' (7a439939-88ac-42ed-936e-90d23a311211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a3fa2775-49ae-4897-855e-9076de05e5fd tempest-VolumesDeleteCascade-1366606570 None] Created volume successfully. Jun 01 09:40:34 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df Jun 01 09:40:34 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:35 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-c8786f9a-461c-45d8-9f11-46754e9ff1e9 req-32e0e6d6-0120-4d28-9f76-e3c272c04206 tempest-AttachVolumeNegativeTest-312487544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df" returned: 0 in 0.746s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-c8786f9a-461c-45d8-9f11-46754e9ff1e9 req-32e0e6d6-0120-4d28-9f76-e3c272c04206 tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.779s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-c8786f9a-461c-45d8-9f11-46754e9ff1e9 req-32e0e6d6-0120-4d28-9f76-e3c272c04206 tempest-AttachVolumeNegativeTest-312487544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-d43454e8-597d-4845-93da-b42ef10c41df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b22c69ba-078e-43e4-af5b-663104012aa7', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:40:35 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-c8786f9a-461c-45d8-9f11-46754e9ff1e9 req-32e0e6d6-0120-4d28-9f76-e3c272c04206 tempest-AttachVolumeNegativeTest-312487544 None] attachment_update completed successfully. Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-64ded766-f2f1-451b-9271-6f70846a7330-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-64ded766-f2f1-451b-9271-6f70846a7330-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Performing cascade delete. {{(pid=86649) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-98a84428-0d36-46d8-892d-a4adbe6890a0-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-98a84428-0d36-46d8-892d-a4adbe6890a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-quobyte-64ded766-f2f1-451b-9271-6f70846a7330" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-64ded766-f2f1-451b-9271-6f70846a7330" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-quobyte-98a84428-0d36-46d8-892d-a4adbe6890a0" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-98a84428-0d36-46d8-892d-a4adbe6890a0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Deleting offline snapshot 98a84428-0d36-46d8-892d-a4adbe6890a0 of volume 64ded766-f2f1-451b-9271-6f70846a7330 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] snapshot_file for this snap is: volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[64851783-54d2-42be-8f59-ce8ca4a80e90]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:35 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 Jun 01 09:40:35 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:36 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0" returned: 0 in 0.791s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64ded766-f2f1-451b-9271-6f70846a7330(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:40:36 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[61493c9e-e003-4e3b-bbbb-af9e83e631ad]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:40:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:36 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:40:36 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:36 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 Jun 01 09:40:36 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:37 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.671s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:40:37 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330" returned: 0 in 0.790s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:37 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 Jun 01 09:40:37 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:38 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0" returned: 0 in 0.691s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:38 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0 Jun 01 09:40:38 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:38 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330.98a84428-0d36-46d8-892d-a4adbe6890a0" returned: 0 in 0.664s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-98a84428-0d36-46d8-892d-a4adbe6890a0" released by "_delete_snapshot" :: held 3.036s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-64ded766-f2f1-451b-9271-6f70846a7330" released by "delete_snapshot" :: held 3.060s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:38 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Created reservations ['56d31d79-7df2-4f90-9d44-51814c3e2bee', 'f703bc7f-86cc-4b1c-9856-c4429ec68104', '9da53206-55c6-4a3e-8e7b-289c07c265c5', '46a8c4f4-8433-48f4-971c-02ebfffb1d5e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:38 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Delete snapshot completed successfully. Jun 01 09:40:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-98a84428-0d36-46d8-892d-a4adbe6890a0-delete_snapshot" released by "delete_snapshot" :: held 3.263s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Snapshots deleted, issuing volume delete {{(pid=86649) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 01 09:40:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-quobyte-64ded766-f2f1-451b-9271-6f70846a7330" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-64ded766-f2f1-451b-9271-6f70846a7330" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[17750ffd-2eed-4a0f-843b-785f6823f0c6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:39 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 Jun 01 09:40:39 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:39 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330" returned: 0 in 0.769s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:39 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330 Jun 01 09:40:39 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:40 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-64ded766-f2f1-451b-9271-6f70846a7330" returned: 0 in 0.739s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-64ded766-f2f1-451b-9271-6f70846a7330" released by "delete_volume" :: held 1.571s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:40 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Created reservations ['5f234e64-77b5-4a54-bab0-dc4183eb3860', 'efc7fcbf-4ba1-4773-ace7-5899ac867cc6', '89950f55-d34c-4587-a4c7-b8d76ed35c48', '01bd1fe1-a44d-4e5d-9241-3c1a5ad4cab5'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:40 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:40:40 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-6ad59050-aed5-4d5b-8413-6883516d7742-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-6ad59050-aed5-4d5b-8413-6883516d7742-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:41 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.658s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:40:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Deleted volume successfully. Jun 01 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-71594cd6-e5ef-4710-8562-4612eb765d54 tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-64ded766-f2f1-451b-9271-6f70846a7330-delete_volume" released by "delete_volume" :: held 5.775s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "cinder-quobyte-6ad59050-aed5-4d5b-8413-6883516d7742" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-6ad59050-aed5-4d5b-8413-6883516d7742" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2bf496-e4c6-4f5a-8a72-b5c917103326]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:41 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742 Jun 01 09:40:41 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-f60a0893-a69e-42f9-8626-ac4937144121 req-2e05fa12-1444-4bea-b9f6-906d99bea298 tempest-AttachVolumeNegativeTest-312487544 None] Terminate volume connection completed successfully. Jun 01 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-f60a0893-a69e-42f9-8626-ac4937144121 req-2e05fa12-1444-4bea-b9f6-906d99bea298 tempest-AttachVolumeNegativeTest-312487544 None] Deleting attachment b22c69ba-078e-43e4-af5b-663104012aa7. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:40:42 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742" returned: 0 in 0.737s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:42 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742 Jun 01 09:40:42 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:42 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ad59050-aed5-4d5b-8413-6883516d7742" returned: 0 in 0.626s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-quobyte-6ad59050-aed5-4d5b-8413-6883516d7742" released by "delete_volume" :: held 1.417s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:42 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=139,cinder:SELECT=115,cinder:INSERT=34,cinder:DELETE=10 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:40:42 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Created reservations ['f5654134-de76-4ea7-8c87-5eabe0721a48', 'b226c6cf-8ad9-42d8-aab7-087d9264a3d2', 'eb38e1a8-e51c-46ee-970a-8eb8a912fffe', '9f7aa480-5f73-4d2b-aac8-1e7207f05985'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:43 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:40:43 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:43 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.599s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:43 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:40:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Deleted volume successfully. Jun 01 09:40:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-34971b53-ddc8-481f-9cb7-3aeee48dba76 tempest-VolumesDeleteCascade-1366606570 None] Lock "cinder-6ad59050-aed5-4d5b-8413-6883516d7742-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:48 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:40:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Flow 'volume_create_manager' (0e80b71c-99f5-4b1c-9147-902c1ea36729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9408bc76-bfdf-451d-9fbc-4ad94901dac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9408bc76-bfdf-451d-9fbc-4ad94901dac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1131509802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f0800d-975a-4d82-b91e-bddccdebdba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fced53ef2241432190d8436a3f3f040e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:49Z,use_quota=True,user_id='f52c091756704cdc8e21a7229bc66622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a587b31-a5a4-41ae-8312-ed0ad7ce7e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a587b31-a5a4-41ae-8312-ed0ad7ce7e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97787325-2f63-4511-a473-3e0abf108e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97787325-2f63-4511-a473-3e0abf108e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98f0800d-975a-4d82-b91e-bddccdebdba5', 'volume_name': 'volume-98f0800d-975a-4d82-b91e-bddccdebdba5', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d49d7ed-50f1-4fe7-919a-5d9f08855c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d49d7ed-50f1-4fe7-919a-5d9f08855c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa63f382-e897-4594-9cfb-06ac6539e5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:49 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Volume 98f0800d-975a-4d82-b91e-bddccdebdba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98f0800d-975a-4d82-b91e-bddccdebdba5', 'volume_size': 1} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1131509802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f0800d-975a-4d82-b91e-bddccdebdba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fced53ef2241432190d8436a3f3f040e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:49Z,use_quota=True,user_id='f52c091756704cdc8e21a7229bc66622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Creating volume 98f0800d-975a-4d82-b91e-bddccdebdba5 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:40:49 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-98f0800d-975a-4d82-b91e-bddccdebdba5 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:49 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-98f0800d-975a-4d82-b91e-bddccdebdba5 1073741824 Jun 01 09:40:49 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Flow 'volume_create_manager' (b8ecd29b-7356-4f20-8ba6-e30baae51641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3821d245-c50d-485e-b5fe-deda478ccb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3821d245-c50d-485e-b5fe-deda478ccb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-961006365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e63eb4-1b38-4549-9e33-9d237af779c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e095dc2fdb4c1ea8cde82f094dc592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:50Z,use_quota=True,user_id='9437eb4907164b86949a0bcd31801d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c75e49f-9763-46da-be3b-5eda1eee5912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c75e49f-9763-46da-be3b-5eda1eee5912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baeb37b6-77e2-40a6-ae76-1bda58ea2430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baeb37b6-77e2-40a6-ae76-1bda58ea2430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e63eb4-1b38-4549-9e33-9d237af779c9', 'volume_name': 'volume-a8e63eb4-1b38-4549-9e33-9d237af779c9', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4e8c1a-155c-4c51-9504-3828527160ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4e8c1a-155c-4c51-9504-3828527160ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1ec1ad-071e-45d2-afe4-f2fef0b0bc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:49 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Volume a8e63eb4-1b38-4549-9e33-9d237af779c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e63eb4-1b38-4549-9e33-9d237af779c9', 'volume_size': 1} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:49 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-98f0800d-975a-4d82-b91e-bddccdebdba5 1073741824" returned: 0 in 0.848s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-98f0800d-975a-4d82-b91e-bddccdebdba5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:49 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-98f0800d-975a-4d82-b91e-bddccdebdba5 Jun 01 09:40:49 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:50 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-98f0800d-975a-4d82-b91e-bddccdebdba5" returned: 0 in 0.590s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.831s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-961006365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e63eb4-1b38-4549-9e33-9d237af779c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e095dc2fdb4c1ea8cde82f094dc592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:50Z,use_quota=True,user_id='9437eb4907164b86949a0bcd31801d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Creating volume a8e63eb4-1b38-4549-9e33-9d237af779c9 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:40:50 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:50 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 1073741824 Jun 01 09:40:50 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa63f382-e897-4594-9cfb-06ac6539e5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98f0800d-975a-4d82-b91e-bddccdebdba5', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d55a38b-ba41-461d-afe0-e8d3197da109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:50 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Volume volume-98f0800d-975a-4d82-b91e-bddccdebdba5 (98f0800d-975a-4d82-b91e-bddccdebdba5): created successfully Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d55a38b-ba41-461d-afe0-e8d3197da109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Flow 'volume_create_manager' (0e80b71c-99f5-4b1c-9147-902c1ea36729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a5e07a3f-2f27-4d11-8fd7-955144b7a909 tempest-VolumesTransfersTest-1553829927 None] Created volume successfully. Jun 01 09:40:51 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 1073741824" returned: 0 in 0.812s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:51 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 Jun 01 09:40:51 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-96b5215c-b858-462c-b31b-a680aa226711 tempest-VolumesTransfersTest-1687945616 None] Transfer volume completed successfully. Jun 01 09:40:52 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9" returned: 0 in 0.661s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1ec1ad-071e-45d2-afe4-f2fef0b0bc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e63eb4-1b38-4549-9e33-9d237af779c9', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a9c606-b86a-4074-8c68-207dfb898f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:52 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Volume volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 (a8e63eb4-1b38-4549-9e33-9d237af779c9): created successfully Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a9c606-b86a-4074-8c68-207dfb898f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Flow 'volume_create_manager' (b8ecd29b-7356-4f20-8ba6-e30baae51641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-dde6d081-cb87-4922-98d7-06b31e8ea57f tempest-SnapshotDependencyTests-1544020749 None] Created volume successfully. Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "cinder-d43454e8-597d-4845-93da-b42ef10c41df-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Lock "cinder-d43454e8-597d-4845-93da-b42ef10c41df-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "cinder-quobyte-d43454e8-597d-4845-93da-b42ef10c41df" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Lock "cinder-quobyte-d43454e8-597d-4845-93da-b42ef10c41df" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cc4514-b6b8-4dde-9556-24539e3d5e21]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:52 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df Jun 01 09:40:52 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Acquiring lock "cinder-98f0800d-975a-4d82-b91e-bddccdebdba5-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Lock "cinder-98f0800d-975a-4d82-b91e-bddccdebdba5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Acquiring lock "cinder-quobyte-98f0800d-975a-4d82-b91e-bddccdebdba5" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Lock "cinder-quobyte-98f0800d-975a-4d82-b91e-bddccdebdba5" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b8f721-bb39-46eb-9e75-1dc586c9ae0d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-98f0800d-975a-4d82-b91e-bddccdebdba5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:52 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-98f0800d-975a-4d82-b91e-bddccdebdba5 Jun 01 09:40:52 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] Creating offline snapshot f848fc86-913f-4c1d-92e5-b52cc94d7cdc of volume a8e63eb4-1b38-4549-9e33-9d237af779c9 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[37156a0f-e715-4e76-9d1e-9c0490d3aec2]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:53 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:53 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 Jun 01 09:40:53 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df" returned: 0 in 0.799s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:53 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df Jun 01 09:40:53 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:53 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-98f0800d-975a-4d82-b91e-bddccdebdba5" returned: 0 in 0.763s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-98f0800d-975a-4d82-b91e-bddccdebdba5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:53 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-98f0800d-975a-4d82-b91e-bddccdebdba5 Jun 01 09:40:53 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:53 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9" returned: 0 in 0.738s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:53 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d43454e8-597d-4845-93da-b42ef10c41df" returned: 0 in 0.650s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:53 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc 1G Jun 01 09:40:53 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Lock "cinder-quobyte-d43454e8-597d-4845-93da-b42ef10c41df" released by "delete_volume" :: held 1.504s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Created reservations ['99ac58b0-2d55-420f-a2bf-75c47894a3e5', 'a25e618b-63e1-4f44-8d20-7cd7ad0fdc21', 'da5ecf8a-6cca-4052-9420-0c944b129b08', '3cb58d32-c89c-4e8f-b48a-8b88c5795f96'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:54 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:40:54 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:54 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-98f0800d-975a-4d82-b91e-bddccdebdba5" returned: 0 in 0.618s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Lock "cinder-quobyte-98f0800d-975a-4d82-b91e-bddccdebdba5" released by "delete_volume" :: held 1.426s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Created reservations ['0bb9be53-5b8c-4ac8-b0d2-be6b232bef59', 'e4f8b930-0e97-472a-a75d-6253f59ade9f', 'f90c8a5a-8f0c-4c01-b5a4-02e2df7b7758', 'ba626192-dfb2-4f28-8cf3-9c0119c5ca2a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:54 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:40:54 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:54 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "cinder-a44124ff-39ac-433a-81e9-5e3c16582300-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:54 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.687s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc 1G" returned: 0 in 0.851s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Deleted volume successfully. Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Lock "cinder-a44124ff-39ac-433a-81e9-5e3c16582300-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:54 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc Jun 01 09:40:54 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b66c133-354d-48ea-8289-28961a91cb5e tempest-AttachVolumeNegativeTest-312487544 None] Lock "cinder-d43454e8-597d-4845-93da-b42ef10c41df-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "cinder-quobyte-a44124ff-39ac-433a-81e9-5e3c16582300" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Lock "cinder-quobyte-a44124ff-39ac-433a-81e9-5e3c16582300" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fea8caa-78d1-49ca-bc17-ed21a9513408]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:55 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.741s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:40:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Deleted volume successfully. Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b7a957d5-8d26-4d85-a682-003678f3e5d1 tempest-VolumesTransfersTest-2055862642 None] Lock "cinder-98f0800d-975a-4d82-b91e-bddccdebdba5-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:55 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300 Jun 01 09:40:55 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Flow 'volume_create_manager' (9ed1c957-f7e3-4ab4-a413-e595f9ab769e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e464a51b-3732-4811-905f-00369dadc4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e464a51b-3732-4811-905f-00369dadc4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1560193757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7dd43bd-006b-429f-9eb2-8e8d19f4d25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fced53ef2241432190d8436a3f3f040e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:55Z,use_quota=True,user_id='f52c091756704cdc8e21a7229bc66622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf79c79-cc89-4609-aa3f-7522fa8c4a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf79c79-cc89-4609-aa3f-7522fa8c4a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa8eedd-f9ec-4ca5-be41-031b126b237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa8eedd-f9ec-4ca5-be41-031b126b237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7dd43bd-006b-429f-9eb2-8e8d19f4d25a', 'volume_name': 'volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f34ce5-0c7e-4d65-8a28-758e0dc6bff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f34ce5-0c7e-4d65-8a28-758e0dc6bff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e42502d-b82f-4106-af4f-23ff31e56d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:55 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Volume b7dd43bd-006b-429f-9eb2-8e8d19f4d25a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a', 'volume_size': 1} Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:55 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc" returned: 0 in 0.883s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:55 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc is being set with open permissions: ugo+rw Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:55 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc Jun 01 09:40:55 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:55 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300" returned: 0 in 0.945s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:55 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300 Jun 01 09:40:55 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:56 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc" returned: 0 in 0.596s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:56 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.info Jun 01 09:40:56 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:56 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a44124ff-39ac-433a-81e9-5e3c16582300" returned: 0 in 0.608s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Lock "cinder-quobyte-a44124ff-39ac-433a-81e9-5e3c16582300" released by "delete_volume" :: held 1.628s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:56 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Created reservations ['bfd3ebcd-9347-442e-a494-374304095c8e', '94edc048-5c33-4640-8d2a-f7fa8f26ef7f', 'dee81d7d-75c6-495c-8181-37a27bca082d', '984c5e52-e3b7-498e-89c3-31940c0436e5'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:56 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:40:56 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:56 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.info" returned: 0 in 0.618s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:56 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.info is being set with open permissions: ugo+rw Jun 01 09:40:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:56 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.info Jun 01 09:40:56 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "cinder-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Lock "cinder-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "cinder-quobyte-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:57 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Lock "cinder-quobyte-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.671s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:40:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Deleted volume successfully. Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12e8659-1aac-492d-b854-6b74ee39dcc1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-34475581-3517-4e38-ad42-a494d4e1267a tempest-AttachVolumeNegativeTest-312487544 None] Lock "cinder-a44124ff-39ac-433a-81e9-5e3c16582300-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:57 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf Jun 01 09:40:57 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:57 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.info" returned: 0 in 0.647s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.432s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.945s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1560193757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7dd43bd-006b-429f-9eb2-8e8d19f4d25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fced53ef2241432190d8436a3f3f040e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:55Z,use_quota=True,user_id='f52c091756704cdc8e21a7229bc66622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Creating volume b7dd43bd-006b-429f-9eb2-8e8d19f4d25a {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:40:57 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:57 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a 1073741824 Jun 01 09:40:57 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0eb93653-11b9-4516-bd7a-78f09e81006c tempest-SnapshotDependencyTests-1544020749 None] Create snapshot completed successfully Jun 01 09:40:57 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf" returned: 0 in 0.729s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:58 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf Jun 01 09:40:58 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:58 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a 1073741824" returned: 0 in 0.744s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:58 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a Jun 01 09:40:58 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:58 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf" returned: 0 in 0.613s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Lock "cinder-quobyte-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf" released by "delete_volume" :: held 1.406s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Created reservations ['73889e06-5f44-4707-9753-6fed43b1f54c', '63d35053-a402-4e47-8426-4270587af09b', 'c977b82c-069a-49ff-a128-a561133c042b', '359bd955-6f93-40c6-a65d-a7c8f56bf0e3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:58 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:40:58 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Flow 'volume_create_manager' (c35b9359-8b32-491d-8ba4-8fa09cb6068c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb769ce-7a1e-429b-9d2f-c439b9e84c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb769ce-7a1e-429b-9d2f-c439b9e84c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234ac41a-4a86-4ce9-adbc-47a0f60e07f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e095dc2fdb4c1ea8cde82f094dc592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f848fc86-913f-4c1d-92e5-b52cc94d7cdc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:40:59Z,use_quota=True,user_id='9437eb4907164b86949a0bcd31801d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:59 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8513c10a-a6a9-48cb-a676-8c17c3ba226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8513c10a-a6a9-48cb-a676-8c17c3ba226d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eec520a-5899-426d-82bc-92ce883b1fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eec520a-5899-426d-82bc-92ce883b1fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '234ac41a-4a86-4ce9-adbc-47a0f60e07f7', 'volume_name': 'volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7', 'volume_size': 1, 'snapshot_id': 'f848fc86-913f-4c1d-92e5-b52cc94d7cdc'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afc6c7b-1a0b-4535-bb53-23fa5a37af14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afc6c7b-1a0b-4535-bb53-23fa5a37af14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a48b8b-bfff-425b-a430-c1b9bdadf1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:59 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Volume 234ac41a-4a86-4ce9-adbc-47a0f60e07f7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7', 'volume_size': 1, 'snapshot_id': 'f848fc86-913f-4c1d-92e5-b52cc94d7cdc'} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a" returned: 0 in 0.742s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "cinder-quobyte-f848fc86-913f-4c1d-92e5-b52cc94d7cdc-234ac41a-4a86-4ce9-adbc-47a0f60e07f7" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e42502d-b82f-4106-af4f-23ff31e56d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99efd52a-3c90-41b8-9d89-86b64c7a9489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-quobyte-f848fc86-913f-4c1d-92e5-b52cc94d7cdc-234ac41a-4a86-4ce9-adbc-47a0f60e07f7" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Creating volume 234ac41a-4a86-4ce9-adbc-47a0f60e07f7 from snapshot f848fc86-913f-4c1d-92e5-b52cc94d7cdc {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "cinder-quobyte-234ac41a-4a86-4ce9-adbc-47a0f60e07f7" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:40:59 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Volume volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a (b7dd43bd-006b-429f-9eb2-8e8d19f4d25a): created successfully Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99efd52a-3c90-41b8-9d89-86b64c7a9489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Flow 'volume_create_manager' (9ed1c957-f7e3-4ab4-a413-e595f9ab769e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-quobyte-234ac41a-4a86-4ce9-adbc-47a0f60e07f7" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] snapshot: f848fc86-913f-4c1d-92e5-b52cc94d7cdc, volume: 234ac41a-4a86-4ce9-adbc-47a0f60e07f7, {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 01 09:40:59 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-464762b4-f2c3-4647-ab68-dc508a33ec89 tempest-VolumesTransfersTest-1553829927 None] Created volume successfully. Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49f8285-ce83-4ed9-ba0c-4a7c0079f975]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:40:59 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc Jun 01 09:40:59 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:40:59 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.682s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:40:59 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Deleted volume successfully. Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-18854a27-d2b1-432a-84f9-47aa76b78b07 tempest-AttachVolumeNegativeTest-312487544 None] Lock "cinder-6b89d4d5-16d2-45c7-bf8f-fa11bec3cecf-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:40:59 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc" returned: 0 in 0.761s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e63eb4-1b38-4549-9e33-9d237af779c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[75733269-8b95-4132-bb38-9a2c25d526f3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:40:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Acquiring lock "cinder-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Lock "cinder-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:00 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 Jun 01 09:41:00 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Acquiring lock "cinder-quobyte-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Lock "cinder-quobyte-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:00 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[31549ce2-c31d-4b05-a453-ab131e9b98f9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:00 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a Jun 01 09:41:00 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:00 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9" returned: 0 in 0.810s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Path /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 01 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:00 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7 Jun 01 09:41:00 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:00 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a" returned: 0 in 0.789s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:01 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a Jun 01 09:41:01 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:01 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a" returned: 0 in 0.622s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Lock "cinder-quobyte-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a" released by "delete_volume" :: held 1.466s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:01 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=139,cinder:INSERT=35,cinder:SELECT=108,cinder:DELETE=12 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:41:01 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Created reservations ['1ed00df2-2fa0-4827-917b-6b425e8a858c', '76308678-2dd4-4c05-98d8-554d376a2e5f', '543fd011-44f7-4998-9667-b8ca50f6e205', '4622c5b8-aacb-4a77-9920-cf4bd2aece32'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:41:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:02 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:41:02 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:03 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.256s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:03 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:41:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Deleted volume successfully. Jun 01 09:41:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1819f87f-6bab-4f42-bd21-c88af40a8fc9 tempest-VolumesTransfersTest-2055862642 None] Lock "cinder-b7dd43bd-006b-429f-9eb2-8e8d19f4d25a-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:06 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7" returned: 0 in 5.947s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:06 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb68a0f8-754b-4ab3-a617-29ab9390f695]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:41:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:06 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 Jun 01 09:41:06 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:07 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9" returned: 0 in 1.048s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:07 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Image conversion details: src /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:41:07 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Converted 1024.00 MB image at 172.14 MB/s Jun 01 09:41:07 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7 is being set with open permissions: ugo+rw Jun 01 09:41:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:07 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7 Jun 01 09:41:07 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:08 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7" returned: 0 in 0.625s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-quobyte-234ac41a-4a86-4ce9-adbc-47a0f60e07f7" released by "_copy_volume_from_snapshot" :: held 9.301s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-quobyte-f848fc86-913f-4c1d-92e5-b52cc94d7cdc-234ac41a-4a86-4ce9-adbc-47a0f60e07f7" released by "_create_volume_from_snapshot" :: held 9.347s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.376s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a48b8b-bfff-425b-a430-c1b9bdadf1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7', 'volume_size': 1, 'snapshot_id': 'f848fc86-913f-4c1d-92e5-b52cc94d7cdc'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315262bb-734f-41fb-a8c8-b4b9070b2a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:08 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Volume volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7 (234ac41a-4a86-4ce9-adbc-47a0f60e07f7): created successfully Jun 01 09:41:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315262bb-734f-41fb-a8c8-b4b9070b2a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Flow 'volume_create_manager' (c35b9359-8b32-491d-8ba4-8fa09cb6068c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:08 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8cc2ad94-642b-49d3-9f00-01a1b2a1a864 tempest-SnapshotDependencyTests-1544020749 None] Created volume successfully. Jun 01 09:41:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "cinder-f848fc86-913f-4c1d-92e5-b52cc94d7cdc-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-f848fc86-913f-4c1d-92e5-b52cc94d7cdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "cinder-quobyte-a8e63eb4-1b38-4549-9e33-9d237af779c9" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-quobyte-a8e63eb4-1b38-4549-9e33-9d237af779c9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "cinder-quobyte-f848fc86-913f-4c1d-92e5-b52cc94d7cdc" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-quobyte-f848fc86-913f-4c1d-92e5-b52cc94d7cdc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Deleting offline snapshot f848fc86-913f-4c1d-92e5-b52cc94d7cdc of volume a8e63eb4-1b38-4549-9e33-9d237af779c9 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:41:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] snapshot_file for this snap is: volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:41:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccbfa0c-5057-434a-892a-1070dffcfd0e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:41:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:09 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc Jun 01 09:41:09 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:09 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc" returned: 0 in 0.750s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e63eb4-1b38-4549-9e33-9d237af779c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:41:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[86161777-502f-4865-956a-adca365acda8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:41:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:10 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 Jun 01 09:41:10 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:10 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9" returned: 0 in 0.805s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:10 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc Jun 01 09:41:10 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:11 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc" returned: 0 in 0.803s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:11 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc Jun 01 09:41:11 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:12 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9.f848fc86-913f-4c1d-92e5-b52cc94d7cdc" returned: 0 in 0.666s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-quobyte-f848fc86-913f-4c1d-92e5-b52cc94d7cdc" released by "_delete_snapshot" :: held 3.161s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-quobyte-a8e63eb4-1b38-4549-9e33-9d237af779c9" released by "delete_snapshot" :: held 3.193s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Created reservations ['7fd6b9ed-02a3-41ea-9db0-f2906cd451af', '3d35f390-a89d-43d9-ac38-b0b01c656ceb', '6812ac12-57eb-4346-8679-a003c2569f2b', 'f0535c73-0cdc-4a54-a2d2-d72a548737cd'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:41:12 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Delete snapshot completed successfully. Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d738f555-12e5-49c5-8b27-40832a9f83eb tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-f848fc86-913f-4c1d-92e5-b52cc94d7cdc-delete_snapshot" released by "delete_snapshot" :: held 3.366s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Flow 'volume_create_manager' (fcb54b3a-7f6f-48a8-9cde-f3258c11fcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a775d9-ff4d-4a87-9b70-16a38324ce40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a775d9-ff4d-4a87-9b70-16a38324ce40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1969226777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772105e6-e419-4f66-903d-2b028880d5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f78f5647944b7dacd04423ad1130ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:13Z,use_quota=True,user_id='25dba0f814bf43a68d2d339fbb5705c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5cfe26-4b0a-44a2-ae2d-9186af6c4a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5cfe26-4b0a-44a2-ae2d-9186af6c4a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f30bd77-4c4e-4fd8-b754-889fafe78907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f30bd77-4c4e-4fd8-b754-889fafe78907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '772105e6-e419-4f66-903d-2b028880d5ca', 'volume_name': 'volume-772105e6-e419-4f66-903d-2b028880d5ca', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38834d55-ecd9-45a7-90d6-8d5aba448e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38834d55-ecd9-45a7-90d6-8d5aba448e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38adab9-1624-4af4-a410-912d129ad241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:12 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Volume 772105e6-e419-4f66-903d-2b028880d5ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-772105e6-e419-4f66-903d-2b028880d5ca', 'volume_size': 1} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1969226777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772105e6-e419-4f66-903d-2b028880d5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f78f5647944b7dacd04423ad1130ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:13Z,use_quota=True,user_id='25dba0f814bf43a68d2d339fbb5705c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Creating volume 772105e6-e419-4f66-903d-2b028880d5ca {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:41:12 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:41:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-772105e6-e419-4f66-903d-2b028880d5ca 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:13 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-772105e6-e419-4f66-903d-2b028880d5ca 1073741824 Jun 01 09:41:13 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "cinder-a8e63eb4-1b38-4549-9e33-9d237af779c9-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-a8e63eb4-1b38-4549-9e33-9d237af779c9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "cinder-quobyte-a8e63eb4-1b38-4549-9e33-9d237af779c9" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-quobyte-a8e63eb4-1b38-4549-9e33-9d237af779c9" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:13 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d10e02-1550-420b-9db6-939fcd295544]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:41:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:13 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 Jun 01 09:41:13 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:13 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-772105e6-e419-4f66-903d-2b028880d5ca 1073741824" returned: 0 in 0.993s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-772105e6-e419-4f66-903d-2b028880d5ca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:14 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-772105e6-e419-4f66-903d-2b028880d5ca Jun 01 09:41:14 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:14 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9" returned: 0 in 0.801s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:14 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9 Jun 01 09:41:14 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:14 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-772105e6-e419-4f66-903d-2b028880d5ca" returned: 0 in 0.618s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:41:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38adab9-1624-4af4-a410-912d129ad241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-772105e6-e419-4f66-903d-2b028880d5ca', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52affe6-c384-47cd-a641-4299b8679146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:14 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Volume volume-772105e6-e419-4f66-903d-2b028880d5ca (772105e6-e419-4f66-903d-2b028880d5ca): created successfully Jun 01 09:41:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52affe6-c384-47cd-a641-4299b8679146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Flow 'volume_create_manager' (fcb54b3a-7f6f-48a8-9cde-f3258c11fcc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-81e89b06-89e7-44e8-9d36-df06cc39cd20 tempest-VolumesTransfersV357Test-757795565 None] Created volume successfully. Jun 01 09:41:14 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a8e63eb4-1b38-4549-9e33-9d237af779c9" returned: 0 in 0.633s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-quobyte-a8e63eb4-1b38-4549-9e33-9d237af779c9" released by "delete_volume" :: held 1.514s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Created reservations ['5439cd79-ada7-4d65-bae1-5102567d2ce4', '7cc73cc8-3a97-446e-92c7-9291f0f71c7a', '284329d8-e5d0-4087-95cb-190a54e568dd', '0fa7d278-5912-4f51-ad73-9d16aa4996ff'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:15 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:41:15 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "cinder-234ac41a-4a86-4ce9-adbc-47a0f60e07f7-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-234ac41a-4a86-4ce9-adbc-47a0f60e07f7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "cinder-quobyte-234ac41a-4a86-4ce9-adbc-47a0f60e07f7" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-quobyte-234ac41a-4a86-4ce9-adbc-47a0f60e07f7" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[04787f58-f3b0-499f-a2a7-f9f1444b795e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:15 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.713s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:41:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Deleted volume successfully. Jun 01 09:41:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05999568-2684-4fd5-abce-0f24513e3123 tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-a8e63eb4-1b38-4549-9e33-9d237af779c9-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:15 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7 Jun 01 09:41:15 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5241621b-148a-402a-a74b-ccead1b5892c tempest-VolumesTransfersV357Test-1148793538 None] Transfer volume completed successfully. Jun 01 09:41:16 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7" returned: 0 in 0.790s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:16 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7 Jun 01 09:41:16 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:17 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-234ac41a-4a86-4ce9-adbc-47a0f60e07f7" returned: 0 in 0.640s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Acquiring lock "cinder-772105e6-e419-4f66-903d-2b028880d5ca-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-quobyte-234ac41a-4a86-4ce9-adbc-47a0f60e07f7" released by "delete_volume" :: held 1.496s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Lock "cinder-772105e6-e419-4f66-903d-2b028880d5ca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Acquiring lock "cinder-quobyte-772105e6-e419-4f66-903d-2b028880d5ca" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Lock "cinder-quobyte-772105e6-e419-4f66-903d-2b028880d5ca" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Created reservations ['13a7ecd9-26d7-4fe4-b30e-7ec339456393', '32207904-6cf1-475b-b0fd-cc4bf570dcc0', 'c349a3a8-3def-4a65-90f0-2de7f6186c49', 'e1fdc218-2a94-401a-967a-78bfb0dd400e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a09d0e-614c-4bef-86cc-2df43bc3c3bd]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-772105e6-e419-4f66-903d-2b028880d5ca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:17 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:41:17 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:17 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-772105e6-e419-4f66-903d-2b028880d5ca Jun 01 09:41:17 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:18 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.688s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:18 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:41:18 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Deleted volume successfully. Jun 01 09:41:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-772105e6-e419-4f66-903d-2b028880d5ca" returned: 0 in 0.783s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-772105e6-e419-4f66-903d-2b028880d5ca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:18 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-772105e6-e419-4f66-903d-2b028880d5ca Jun 01 09:41:18 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-74f5907e-3c5a-4298-a12a-8310cec9ebd5 tempest-SnapshotDependencyTests-1544020749 None] Lock "cinder-234ac41a-4a86-4ce9-adbc-47a0f60e07f7-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:18 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-772105e6-e419-4f66-903d-2b028880d5ca" returned: 0 in 0.678s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Lock "cinder-quobyte-772105e6-e419-4f66-903d-2b028880d5ca" released by "delete_volume" :: held 1.514s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:18 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Created reservations ['9b23bcfd-60fc-44e7-83db-d2bf47c174c6', 'a2953d90-a0fa-490f-aa9d-71e256b81a99', 'bd0b56e9-4125-4c5d-9ace-3200ede2a52f', 'bf819589-f525-42ed-8f47-f0637d0333b5'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:41:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:18 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:41:18 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f0eda9bd-db23-45d8-b3d9-fc1aafc7e89d tempest-GroupsV320Test-222544617 None] Group tempest-GroupsV320Test-Group-375515172: creating Jun 01 09:41:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f0eda9bd-db23-45d8-b3d9-fc1aafc7e89d tempest-GroupsV320Test-222544617 None] Group tempest-GroupsV320Test-Group-375515172: created successfully Jun 01 09:41:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f0eda9bd-db23-45d8-b3d9-fc1aafc7e89d tempest-GroupsV320Test-222544617 None] Create group completed successfully. Jun 01 09:41:19 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.703s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:41:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Deleted volume successfully. Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1804abeb-7ad8-451f-9e9b-d108f0800fb4 tempest-VolumesTransfersV357Test-14891557 None] Lock "cinder-772105e6-e419-4f66-903d-2b028880d5ca-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Flow 'volume_create_manager' (1dfc46fb-11a4-4564-8d11-04f7653773ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f798e3-6689-4278-ae2a-6cbebfb271c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f798e3-6689-4278-ae2a-6cbebfb271c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1013193616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c5e75d-e44d-4eb4-bf24-0a4455f315a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f78f5647944b7dacd04423ad1130ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:20Z,use_quota=True,user_id='25dba0f814bf43a68d2d339fbb5705c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c595da-ade5-4e85-b23b-3f4898ddfd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c595da-ade5-4e85-b23b-3f4898ddfd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c0b6d7-bda9-43ad-b660-2caac7b1a7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c0b6d7-bda9-43ad-b660-2caac7b1a7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c5e75d-e44d-4eb4-bf24-0a4455f315a4', 'volume_name': 'volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35155774-c73b-45b2-8e9d-98b8e3ad8e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35155774-c73b-45b2-8e9d-98b8e3ad8e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d663f942-05db-4be0-857c-e41b11cbe9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:19 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Volume 44c5e75d-e44d-4eb4-bf24-0a4455f315a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4', 'volume_size': 1} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1013193616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c5e75d-e44d-4eb4-bf24-0a4455f315a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f78f5647944b7dacd04423ad1130ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:20Z,use_quota=True,user_id='25dba0f814bf43a68d2d339fbb5705c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Creating volume 44c5e75d-e44d-4eb4-bf24-0a4455f315a4 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:41:19 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:41:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:20 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4 1073741824 Jun 01 09:41:20 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:20 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-288bb41f-60e5-427f-b464-55b87883cb13 tempest-GroupsV320Test-222544617 None] Created reservations ['b9cf1ee7-2668-430d-a945-dd76ead5a10e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:41:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-288bb41f-60e5-427f-b464-55b87883cb13 tempest-GroupsV320Test-222544617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-288bb41f-60e5-427f-b464-55b87883cb13 tempest-GroupsV320Test-222544617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-288bb41f-60e5-427f-b464-55b87883cb13 tempest-GroupsV320Test-222544617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-288bb41f-60e5-427f-b464-55b87883cb13 tempest-GroupsV320Test-222544617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-288bb41f-60e5-427f-b464-55b87883cb13 tempest-GroupsV320Test-222544617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-288bb41f-60e5-427f-b464-55b87883cb13 tempest-GroupsV320Test-222544617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:20 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:41:20 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:21 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4 1073741824" returned: 0 in 1.089s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:21 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4 Jun 01 09:41:21 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:21 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-288bb41f-60e5-427f-b464-55b87883cb13 tempest-GroupsV320Test-222544617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.709s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-288bb41f-60e5-427f-b464-55b87883cb13 tempest-GroupsV320Test-222544617 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:41:21 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-288bb41f-60e5-427f-b464-55b87883cb13 tempest-GroupsV320Test-222544617 None] Delete group completed successfully. Jun 01 09:41:21 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4" returned: 0 in 0.632s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:41:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d663f942-05db-4be0-857c-e41b11cbe9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec0e104-6e34-47af-b27d-366a7f9f52e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:21 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Volume volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4 (44c5e75d-e44d-4eb4-bf24-0a4455f315a4): created successfully Jun 01 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec0e104-6e34-47af-b27d-366a7f9f52e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Flow 'volume_create_manager' (1dfc46fb-11a4-4564-8d11-04f7653773ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:21 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e30ce6a9-1e54-42d7-a051-4b278d5eb8f6 tempest-VolumesTransfersV357Test-757795565 None] Created volume successfully. Jun 01 09:41:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Acquiring lock "cinder-44c5e75d-e44d-4eb4-bf24-0a4455f315a4-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Lock "cinder-44c5e75d-e44d-4eb4-bf24-0a4455f315a4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Acquiring lock "cinder-quobyte-44c5e75d-e44d-4eb4-bf24-0a4455f315a4" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Lock "cinder-quobyte-44c5e75d-e44d-4eb4-bf24-0a4455f315a4" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:22 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c776616d-3e38-4007-af0c-0842d1c6ab52]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:41:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:22 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4 Jun 01 09:41:22 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:23 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4" returned: 0 in 0.820s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:23 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4 Jun 01 09:41:23 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:23 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-44c5e75d-e44d-4eb4-bf24-0a4455f315a4" returned: 0 in 0.664s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Lock "cinder-quobyte-44c5e75d-e44d-4eb4-bf24-0a4455f315a4" released by "delete_volume" :: held 1.538s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:24 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Created reservations ['7f44780f-12bf-4518-b349-d7352065890d', '1d1d9c85-0c65-4e58-8c71-8f4b865ce8c5', '0e4f3c66-2a99-493b-8bdb-e3ece7b73f3f', '7b0e0729-428d-4d88-a5a5-647d44acf524'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:41:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:24 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:41:24 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:24 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.721s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:24 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:41:24 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Deleted volume successfully. Jun 01 09:41:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aecf8e2d-9d43-44c4-98d3-0ee28b0ad539 tempest-VolumesTransfersV357Test-14891557 None] Lock "cinder-44c5e75d-e44d-4eb4-bf24-0a4455f315a4-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Flow 'volume_create_manager' (5a9553a8-56ad-45cf-9db8-2901f015dd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb59ce7-9ae1-4777-97b3-fc351da3e0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb59ce7-9ae1-4777-97b3-fc351da3e0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-596725012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f843c5f2-5bc6-426b-9f55-3bc1df8a37b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0307dbc2708e43749f9cba930f654109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:30Z,use_quota=True,user_id='389b49a9d42b4a759116597c91be7e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c0704b-c167-489c-af60-18133daf1113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c0704b-c167-489c-af60-18133daf1113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881005cf-60bc-43b1-bc0e-a06e172086e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881005cf-60bc-43b1-bc0e-a06e172086e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f843c5f2-5bc6-426b-9f55-3bc1df8a37b2', 'volume_name': 'volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8808f4fa-9a73-4e01-868e-be0717e3e474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8808f4fa-9a73-4e01-868e-be0717e3e474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76d14d6-e257-4151-b0ca-d525b5eeb6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:29 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Volume f843c5f2-5bc6-426b-9f55-3bc1df8a37b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2', 'volume_size': 1} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-596725012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f843c5f2-5bc6-426b-9f55-3bc1df8a37b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0307dbc2708e43749f9cba930f654109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:30Z,use_quota=True,user_id='389b49a9d42b4a759116597c91be7e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Creating volume f843c5f2-5bc6-426b-9f55-3bc1df8a37b2 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:41:29 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:41:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:29 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2 1073741824 Jun 01 09:41:29 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:30 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:41:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Flow 'volume_create_manager' (85d7f6ce-5333-4401-8a50-f90a20ec869b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9115697b-675f-4ef3-a863-09669a31f4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9115697b-675f-4ef3-a863-09669a31f4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1194619826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba90dc58-556d-4213-9297-a7209d62126e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82abd89a88414a58bd6147db02fa3d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:31Z,use_quota=True,user_id='7689061de22c4350822a8ac13106aca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18511518-9506-45fb-88f9-7c1d998ff954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18511518-9506-45fb-88f9-7c1d998ff954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d550f653-037b-494e-82bb-061c6d72b6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d550f653-037b-494e-82bb-061c6d72b6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba90dc58-556d-4213-9297-a7209d62126e', 'volume_name': 'volume-ba90dc58-556d-4213-9297-a7209d62126e', 'volume_size': 2}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4529ea4-d581-4097-a0ec-37a4d6ea89e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4529ea4-d581-4097-a0ec-37a4d6ea89e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1238718-e5d8-4dad-8810-5d1a02410f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:30 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Volume ba90dc58-556d-4213-9297-a7209d62126e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba90dc58-556d-4213-9297-a7209d62126e', 'volume_size': 2} Jun 01 09:41:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:30 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2 1073741824" returned: 0 in 0.831s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:30 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2 Jun 01 09:41:30 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:31 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2" returned: 0 in 0.581s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.710s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1194619826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba90dc58-556d-4213-9297-a7209d62126e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82abd89a88414a58bd6147db02fa3d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:31Z,use_quota=True,user_id='7689061de22c4350822a8ac13106aca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Creating volume ba90dc58-556d-4213-9297-a7209d62126e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:41:31 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ba90dc58-556d-4213-9297-a7209d62126e 2147483648 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76d14d6-e257-4151-b0ca-d525b5eeb6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb08ff96-8c47-4f8b-983a-c963cafc0eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:31 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ba90dc58-556d-4213-9297-a7209d62126e 2147483648 Jun 01 09:41:31 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:31 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Volume volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2 (f843c5f2-5bc6-426b-9f55-3bc1df8a37b2): created successfully Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb08ff96-8c47-4f8b-983a-c963cafc0eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Flow 'volume_create_manager' (5a9553a8-56ad-45cf-9db8-2901f015dd2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b9886c20-294d-4f5a-8adc-16c311d9ed85 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Created volume successfully. Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Acquiring lock "cinder-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Lock "cinder-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Acquiring lock "cinder-quobyte-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Lock "cinder-quobyte-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd4bfc3-ed62-4d6a-8e79-cced8bacd1b7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:32 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ba90dc58-556d-4213-9297-a7209d62126e 2147483648" returned: 0 in 0.848s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:32 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2 Jun 01 09:41:32 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ba90dc58-556d-4213-9297-a7209d62126e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:32 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ba90dc58-556d-4213-9297-a7209d62126e Jun 01 09:41:32 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:32 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ba90dc58-556d-4213-9297-a7209d62126e" returned: 0 in 0.602s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:32 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1238718-e5d8-4dad-8810-5d1a02410f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba90dc58-556d-4213-9297-a7209d62126e', 'volume_size': 2}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720b74ae-d8fe-41e5-bfbb-c9dd2c5f8cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2" returned: 0 in 0.762s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:32 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Volume volume-ba90dc58-556d-4213-9297-a7209d62126e (ba90dc58-556d-4213-9297-a7209d62126e): created successfully Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720b74ae-d8fe-41e5-bfbb-c9dd2c5f8cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:32 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2 Jun 01 09:41:32 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Flow 'volume_create_manager' (85d7f6ce-5333-4401-8a50-f90a20ec869b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-01654ed0-417f-4d51-be83-226038561c43 tempest-VolumesCloneNegativeTest-1009600175 None] Created volume successfully. Jun 01 09:41:33 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2" returned: 0 in 0.582s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Lock "cinder-quobyte-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2" released by "delete_volume" :: held 1.382s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:33 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Created reservations ['5cc05a74-9bf1-40e4-9c15-55538bde5c04', 'bd221501-ae26-4b90-bd40-386efa0ae0ab', 'fcedd55e-00ee-4105-afbe-1dc0d3d3f016', '08939e7e-c768-4e45-8cee-d1338657424a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:41:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:33 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:41:33 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Acquiring lock "cinder-ba90dc58-556d-4213-9297-a7209d62126e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Lock "cinder-ba90dc58-556d-4213-9297-a7209d62126e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Acquiring lock "cinder-quobyte-ba90dc58-556d-4213-9297-a7209d62126e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Lock "cinder-quobyte-ba90dc58-556d-4213-9297-a7209d62126e" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee50eab-8341-496a-a96d-3aa0c5e50198]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ba90dc58-556d-4213-9297-a7209d62126e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:34 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ba90dc58-556d-4213-9297-a7209d62126e Jun 01 09:41:34 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:34 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.614s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:41:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Deleted volume successfully. Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-788bb4fa-327a-4dcd-8ca6-483dea445619 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Lock "cinder-f843c5f2-5bc6-426b-9f55-3bc1df8a37b2-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Flow 'volume_create_manager' (2d8617c4-cc4e-4531-9c0f-1136f3cd8ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b03370a-065d-426b-ac69-ea2b1bbf7a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b03370a-065d-426b-ac69-ea2b1bbf7a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1091957304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d44736f-5d53-4ded-b391-a7aa00e9cd20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0307dbc2708e43749f9cba930f654109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:35Z,use_quota=True,user_id='389b49a9d42b4a759116597c91be7e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d10b8c8-2509-49e5-8446-d6d75ed14f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d10b8c8-2509-49e5-8446-d6d75ed14f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d578c6b6-6880-4dc6-85a2-02ed3fb2a625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d578c6b6-6880-4dc6-85a2-02ed3fb2a625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d44736f-5d53-4ded-b391-a7aa00e9cd20', 'volume_name': 'volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216f0ae6-0db6-46c1-993e-1be7f25c08ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216f0ae6-0db6-46c1-993e-1be7f25c08ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0742588b-3f68-450b-95e1-ddb6b4d685c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:34 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Volume 9d44736f-5d53-4ded-b391-a7aa00e9cd20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20', 'volume_size': 1} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1091957304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d44736f-5d53-4ded-b391-a7aa00e9cd20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0307dbc2708e43749f9cba930f654109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:35Z,use_quota=True,user_id='389b49a9d42b4a759116597c91be7e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Creating volume 9d44736f-5d53-4ded-b391-a7aa00e9cd20 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:41:34 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:34 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20 1073741824 Jun 01 09:41:34 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:34 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ba90dc58-556d-4213-9297-a7209d62126e" returned: 0 in 0.787s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ba90dc58-556d-4213-9297-a7209d62126e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:34 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ba90dc58-556d-4213-9297-a7209d62126e Jun 01 09:41:34 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:35 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ba90dc58-556d-4213-9297-a7209d62126e" returned: 0 in 0.632s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Lock "cinder-quobyte-ba90dc58-556d-4213-9297-a7209d62126e" released by "delete_volume" :: held 1.465s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:35 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Created reservations ['82991608-91f7-41c9-bf2b-a4baeb432925', '652c11c0-a8fe-4a6d-9158-58afa806f43a', '381c3caa-01dd-4087-a748-def50284715f', '69849682-eca0-4721-9812-6c25978e6d54'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:41:35 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20 1073741824" returned: 0 in 0.758s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:35 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20 Jun 01 09:41:35 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:35 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:41:35 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:36 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20" returned: 0 in 0.598s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0742588b-3f68-450b-95e1-ddb6b4d685c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f6d0f3-e616-46d9-b6af-a6e9e1000ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:36 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.602s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:41:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Deleted volume successfully. Jun 01 09:41:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Volume volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20 (9d44736f-5d53-4ded-b391-a7aa00e9cd20): created successfully Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f6d0f3-e616-46d9-b6af-a6e9e1000ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Flow 'volume_create_manager' (2d8617c4-cc4e-4531-9c0f-1136f3cd8ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-56831f7c-c390-42c4-8566-3156d494e578 tempest-VolumeQuotasAdminTestJSON-1231589895 None] Created volume successfully. Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6e5f1a1e-eb0d-4126-bf47-5cd549576315 tempest-VolumesCloneNegativeTest-1009600175 None] Lock "cinder-ba90dc58-556d-4213-9297-a7209d62126e-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:36 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:41:36 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:37 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.684s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:41:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e8984dae-ec2a-420f-bbed-e5332f28fea3 tempest-VolumeQuotasAdminTestJSON-731485570 None] Transfer volume completed successfully. Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Acquiring lock "cinder-9d44736f-5d53-4ded-b391-a7aa00e9cd20-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Lock "cinder-9d44736f-5d53-4ded-b391-a7aa00e9cd20-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Acquiring lock "cinder-quobyte-9d44736f-5d53-4ded-b391-a7aa00e9cd20" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Lock "cinder-quobyte-9d44736f-5d53-4ded-b391-a7aa00e9cd20" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b193639-b1f3-46c3-bc30-a1f87b577bab]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:38 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20 Jun 01 09:41:38 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Flow 'volume_create_manager' (f76bc33a-147b-4489-b994-a3a5497a4558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0945b1-c250-4387-801c-a3de3b99ffbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0945b1-c250-4387-801c-a3de3b99ffbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1149642933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c756a3-dea5-47fa-a2a8-bab9a45f31a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da333305f60440ffb42753adac520718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:39Z,use_quota=True,user_id='0ffb743f4c614a26bf90bd8840d7bc9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413f184d-cdf6-40b2-be33-f86e01650ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413f184d-cdf6-40b2-be33-f86e01650ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9646f9ac-9eae-47a0-a84d-1a189de2437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9646f9ac-9eae-47a0-a84d-1a189de2437e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c756a3-dea5-47fa-a2a8-bab9a45f31a2', 'volume_name': 'volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec24bac7-abd5-49e8-a3fd-34d68482a316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec24bac7-abd5-49e8-a3fd-34d68482a316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1bca1ea-c672-4434-aae1-33f2504f5d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:38 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Volume 14c756a3-dea5-47fa-a2a8-bab9a45f31a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2', 'volume_size': 1} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1149642933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c756a3-dea5-47fa-a2a8-bab9a45f31a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da333305f60440ffb42753adac520718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:39Z,use_quota=True,user_id='0ffb743f4c614a26bf90bd8840d7bc9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Creating volume 14c756a3-dea5-47fa-a2a8-bab9a45f31a2 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:41:38 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:41:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:38 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2 1073741824 Jun 01 09:41:38 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:39 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20" returned: 0 in 0.770s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:39 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20 Jun 01 09:41:39 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:39 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2 1073741824" returned: 0 in 0.789s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:39 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2 Jun 01 09:41:39 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:39 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d44736f-5d53-4ded-b391-a7aa00e9cd20" returned: 0 in 0.616s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Lock "cinder-quobyte-9d44736f-5d53-4ded-b391-a7aa00e9cd20" released by "delete_volume" :: held 1.431s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Created reservations ['c3974508-e400-42b2-a94e-6c2902031a9e', 'a239e11d-7054-401c-b791-938216d68282', '9ffd2ba8-4821-4bce-a3af-d350a37c10f2', '41ca36e6-933d-4cca-873d-c4c53cf13170'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:40 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:41:40 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:40 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2" returned: 0 in 0.585s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1bca1ea-c672-4434-aae1-33f2504f5d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f58e169-f68b-4aa9-ae3e-720050215304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:40 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Volume volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2 (14c756a3-dea5-47fa-a2a8-bab9a45f31a2): created successfully Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f58e169-f68b-4aa9-ae3e-720050215304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Flow 'volume_create_manager' (f76bc33a-147b-4489-b994-a3a5497a4558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:40 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-62eb96ef-bf58-4a41-acb5-b1cf5de7afc7 tempest-VolumesNegativeTest-2104349246 None] Created volume successfully. Jun 01 09:41:40 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.605s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:41:40 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Deleted volume successfully. Jun 01 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05b0eae4-507a-4a89-b219-295961a14791 tempest-VolumeQuotasAdminTestJSON-406175334 None] Lock "cinder-9d44736f-5d53-4ded-b391-a7aa00e9cd20-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:INSERT=36,cinder:UPDATE=142,cinder:SELECT=108,cinder:DELETE=13 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Flow 'volume_create_manager' (372d5d27-32e9-49b4-8fbb-03cdcc7fda6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2213b708-c8c9-4cd8-9e33-9e8f6b642c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2213b708-c8c9-4cd8-9e33-9e8f6b642c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1270076637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7b73c3-d31e-44df-ac14-fd781dead187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e99015172ee43398f1191a3a9f3d811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:47Z,use_quota=True,user_id='322945677b2c4c4a8b5a8baae991ce39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(479800c9-1a34-49f5-9e9e-ea42d5e0bc76),volume_type_id=479800c9-1a34-49f5-9e9e-ea42d5e0bc76)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b205141d-9ee8-45b2-9e8b-7516dfa56d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b205141d-9ee8-45b2-9e8b-7516dfa56d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc60975-7dde-4397-b19f-b4ec0d0ad99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc60975-7dde-4397-b19f-b4ec0d0ad99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7b73c3-d31e-44df-ac14-fd781dead187', 'volume_name': 'volume-8a7b73c3-d31e-44df-ac14-fd781dead187', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae7ef03-5a0c-4976-b92b-a07e3c2d2057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae7ef03-5a0c-4976-b92b-a07e3c2d2057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa381d0b-9470-44a1-a248-e909dbb06620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:47 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Volume 8a7b73c3-d31e-44df-ac14-fd781dead187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7b73c3-d31e-44df-ac14-fd781dead187', 'volume_size': 1} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1270076637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7b73c3-d31e-44df-ac14-fd781dead187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e99015172ee43398f1191a3a9f3d811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:47Z,use_quota=True,user_id='322945677b2c4c4a8b5a8baae991ce39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(479800c9-1a34-49f5-9e9e-ea42d5e0bc76),volume_type_id=479800c9-1a34-49f5-9e9e-ea42d5e0bc76)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Creating volume 8a7b73c3-d31e-44df-ac14-fd781dead187 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:41:47 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:41:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8a7b73c3-d31e-44df-ac14-fd781dead187 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:47 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8a7b73c3-d31e-44df-ac14-fd781dead187 1073741824 Jun 01 09:41:47 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:48 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8a7b73c3-d31e-44df-ac14-fd781dead187 1073741824" returned: 0 in 0.804s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8a7b73c3-d31e-44df-ac14-fd781dead187 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:48 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8a7b73c3-d31e-44df-ac14-fd781dead187 Jun 01 09:41:48 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:48 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8a7b73c3-d31e-44df-ac14-fd781dead187" returned: 0 in 0.600s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:41:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa381d0b-9470-44a1-a248-e909dbb06620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7b73c3-d31e-44df-ac14-fd781dead187', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ce92ec-c880-4a1e-858e-705ba6eb38a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:48 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Volume volume-8a7b73c3-d31e-44df-ac14-fd781dead187 (8a7b73c3-d31e-44df-ac14-fd781dead187): created successfully Jun 01 09:41:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ce92ec-c880-4a1e-858e-705ba6eb38a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Flow 'volume_create_manager' (372d5d27-32e9-49b4-8fbb-03cdcc7fda6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0c7973b2-3548-4f03-89c9-0f67d1d1ab81 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Created volume successfully. Jun 01 09:41:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b3598d87-a51d-4905-a4b0-f34f8c401227 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b3598d87-a51d-4905-a4b0-f34f8c401227 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b3598d87-a51d-4905-a4b0-f34f8c401227 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b3598d87-a51d-4905-a4b0-f34f8c401227 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b3598d87-a51d-4905-a4b0-f34f8c401227 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b3598d87-a51d-4905-a4b0-f34f8c401227 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:49 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:41:49 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:50 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b3598d87-a51d-4905-a4b0-f34f8c401227 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.576s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:50 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-b3598d87-a51d-4905-a4b0-f34f8c401227 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:41:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b3598d87-a51d-4905-a4b0-f34f8c401227 tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Retype volume completed successfully. Jun 01 09:41:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Acquiring lock "cinder-8a7b73c3-d31e-44df-ac14-fd781dead187-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Lock "cinder-8a7b73c3-d31e-44df-ac14-fd781dead187-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Acquiring lock "cinder-quobyte-8a7b73c3-d31e-44df-ac14-fd781dead187" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:41:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Lock "cinder-quobyte-8a7b73c3-d31e-44df-ac14-fd781dead187" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:41:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c4d983-8f32-4573-b774-9b77b88b96c4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:41:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8a7b73c3-d31e-44df-ac14-fd781dead187 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:50 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8a7b73c3-d31e-44df-ac14-fd781dead187 Jun 01 09:41:50 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:51 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8a7b73c3-d31e-44df-ac14-fd781dead187" returned: 0 in 0.769s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8a7b73c3-d31e-44df-ac14-fd781dead187 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:51 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8a7b73c3-d31e-44df-ac14-fd781dead187 Jun 01 09:41:51 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:52 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8a7b73c3-d31e-44df-ac14-fd781dead187" returned: 0 in 0.581s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Lock "cinder-quobyte-8a7b73c3-d31e-44df-ac14-fd781dead187" released by "delete_volume" :: held 1.387s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:52 devstack cinder-volume[86649]: WARNING cinder.quota [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:41:52 devstack cinder-volume[86649]: WARNING cinder.quota [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Created reservations ['f0d40f5f-28b1-4f11-8683-8ca8216afd89', 'f6201f5b-e561-4232-88ba-a3ab8f22213d', 'd1583cb5-09b7-4d6d-914e-5fdc82384337', '79b6845d-dd0d-4055-9d38-2fcf1c906b77'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:41:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:52 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:41:52 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:52 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.595s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:41:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Deleted volume successfully. Jun 01 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4f025979-e68e-4327-91ee-527b4f00196e tempest-VolumeRetypeWithoutMigrationTest-1062634873 None] Lock "cinder-8a7b73c3-d31e-44df-ac14-fd781dead187-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Flow 'volume_create_manager' (9caf7260-1614-4f32-8c85-07326c33bd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1659499b-1514-468d-9efb-05dcb73cbebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1659499b-1514-468d-9efb-05dcb73cbebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-840736690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4db6eb-4f53-485f-9ef2-d8e9c36be010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f40ec651d7f44c5b7226996bf68cee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:59Z,use_quota=True,user_id='7a0dee026a604c219de91d7acec4ca56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b98adec-ebc5-40b9-bdd8-560ecfffe1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b98adec-ebc5-40b9-bdd8-560ecfffe1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d94c187-ea0f-45cc-8982-a7f20a151496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d94c187-ea0f-45cc-8982-a7f20a151496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4db6eb-4f53-485f-9ef2-d8e9c36be010', 'volume_name': 'volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de402abd-d6aa-4bf8-ba62-1985c782af22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de402abd-d6aa-4bf8-ba62-1985c782af22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d5047c-18fa-4ee2-af3b-1806503b7f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:41:58 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Volume ee4db6eb-4f53-485f-9ef2-d8e9c36be010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010', 'volume_size': 1} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-840736690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4db6eb-4f53-485f-9ef2-d8e9c36be010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f40ec651d7f44c5b7226996bf68cee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:41:59Z,use_quota=True,user_id='7a0dee026a604c219de91d7acec4ca56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Creating volume ee4db6eb-4f53-485f-9ef2-d8e9c36be010 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:41:58 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:41:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:58 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 1073741824 Jun 01 09:41:58 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:41:59 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jun 01 09:41:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 1073741824" returned: 0 in 0.836s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:41:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:41:59 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 Jun 01 09:41:59 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:00 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010" returned: 0 in 0.581s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d5047c-18fa-4ee2-af3b-1806503b7f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5db3407-2d2a-45ed-a20a-754ce5c2b232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:00 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Volume volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 (ee4db6eb-4f53-485f-9ef2-d8e9c36be010): created successfully Jun 01 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5db3407-2d2a-45ed-a20a-754ce5c2b232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Flow 'volume_create_manager' (9caf7260-1614-4f32-8c85-07326c33bd31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:42:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-23cdc923-c71e-48a9-8c82-81a27f505025 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Created volume successfully. Jun 01 09:42:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Creating offline snapshot 1ddf843b-eadf-4f2e-be00-84903e71c996 of volume ee4db6eb-4f53-485f-9ef2-d8e9c36be010 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:42:01 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[af492baa-9c9f-4f86-80a7-6565c8a2e6db]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:01 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 Jun 01 09:42:01 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:02 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010" returned: 0 in 0.705s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:02 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 1G Jun 01 09:42:02 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:02 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 1G" returned: 0 in 0.757s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:02 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 Jun 01 09:42:02 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:03 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996" returned: 0 in 0.644s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:03 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 is being set with open permissions: ugo+rw Jun 01 09:42:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:03 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 Jun 01 09:42:03 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:04 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996" returned: 0 in 0.592s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:04 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=110,cinder:SELECT=77,cinder:DELETE=9,cinder:INSERT=23 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:42:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:04 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.info Jun 01 09:42:04 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:04 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.info" returned: 0 in 0.622s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:04 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.info is being set with open permissions: ugo+rw Jun 01 09:42:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:04 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.info Jun 01 09:42:04 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:05 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.info" returned: 0 in 0.591s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.004s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2270403c-a769-420f-8e01-6d6d3845f2dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Create snapshot completed successfully Jun 01 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Acquiring lock "cinder-1ddf843b-eadf-4f2e-be00-84903e71c996-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "cinder-1ddf843b-eadf-4f2e-be00-84903e71c996-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Acquiring lock "cinder-quobyte-ee4db6eb-4f53-485f-9ef2-d8e9c36be010" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "cinder-quobyte-ee4db6eb-4f53-485f-9ef2-d8e9c36be010" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Acquiring lock "cinder-quobyte-1ddf843b-eadf-4f2e-be00-84903e71c996" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "cinder-quobyte-1ddf843b-eadf-4f2e-be00-84903e71c996" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Deleting offline snapshot 1ddf843b-eadf-4f2e-be00-84903e71c996 of volume ee4db6eb-4f53-485f-9ef2-d8e9c36be010 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] snapshot_file for this snap is: volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:42:05 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9440d950-ded9-4911-b9af-95e26c4e704e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:06 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 Jun 01 09:42:06 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:06 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996" returned: 0 in 0.719s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:42:06 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[466b0628-b071-4170-b55a-2d71f0247487]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:06 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 Jun 01 09:42:06 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:07 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010" returned: 0 in 0.702s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:07 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 Jun 01 09:42:07 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:08 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996" returned: 0 in 0.718s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:08 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996 Jun 01 09:42:08 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:08 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010.1ddf843b-eadf-4f2e-be00-84903e71c996" returned: 0 in 0.591s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "cinder-quobyte-1ddf843b-eadf-4f2e-be00-84903e71c996" released by "_delete_snapshot" :: held 2.849s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:42:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "cinder-quobyte-ee4db6eb-4f53-485f-9ef2-d8e9c36be010" released by "delete_snapshot" :: held 2.875s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:42:08 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Created reservations ['f0f5c428-1756-4c38-8df8-7d10d7bdc015', '88095ce3-59fc-4cf4-b5a8-b1e2adf6e42a', '22c37ee8-d19d-4b08-8c53-531f0cd58fbe', '1cadc04f-4647-4b25-9124-ce0d00c69f3c'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:42:08 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Delete snapshot completed successfully. Jun 01 09:42:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c2f1388b-ffcd-4dee-a7a5-b942358ffc70 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "cinder-1ddf843b-eadf-4f2e-be00-84903e71c996-delete_snapshot" released by "delete_snapshot" :: held 3.038s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Acquiring lock "cinder-ee4db6eb-4f53-485f-9ef2-d8e9c36be010-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "cinder-ee4db6eb-4f53-485f-9ef2-d8e9c36be010-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Acquiring lock "cinder-quobyte-ee4db6eb-4f53-485f-9ef2-d8e9c36be010" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "cinder-quobyte-ee4db6eb-4f53-485f-9ef2-d8e9c36be010" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:42:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2864aab-c9cd-4dbd-870a-f36ca2b82799]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:09 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 Jun 01 09:42:09 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010" returned: 0 in 0.708s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:09 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:09 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010 Jun 01 09:42:09 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Acquiring lock "cinder-14c756a3-dea5-47fa-a2a8-bab9a45f31a2-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Lock "cinder-14c756a3-dea5-47fa-a2a8-bab9a45f31a2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Acquiring lock "cinder-quobyte-14c756a3-dea5-47fa-a2a8-bab9a45f31a2" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Lock "cinder-quobyte-14c756a3-dea5-47fa-a2a8-bab9a45f31a2" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c3d2f5-138f-4a92-b017-127d30ea90bf]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:10 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2 Jun 01 09:42:10 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:10 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee4db6eb-4f53-485f-9ef2-d8e9c36be010" returned: 0 in 0.595s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "cinder-quobyte-ee4db6eb-4f53-485f-9ef2-d8e9c36be010" released by "delete_volume" :: held 1.361s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Created reservations ['1f2e4306-b960-421d-80e5-114b3baa41ed', 'b6041c2e-0bb6-4b40-95b1-56783884663e', 'fee12cd1-7ffc-4adc-bfa7-a89f3dd5fa9f', 'd3933cbb-8457-4d9c-b774-2abd098510c5'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:10 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:42:10 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:10 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2" returned: 0 in 0.720s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:11 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2 Jun 01 09:42:11 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:11 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.597s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:11 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:42:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Deleted volume successfully. Jun 01 09:42:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b349616d-c1c4-40ba-9f72-ed27f1e1fe46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370249285 None] Lock "cinder-ee4db6eb-4f53-485f-9ef2-d8e9c36be010-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:42:11 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-14c756a3-dea5-47fa-a2a8-bab9a45f31a2" returned: 0 in 0.612s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Lock "cinder-quobyte-14c756a3-dea5-47fa-a2a8-bab9a45f31a2" released by "delete_volume" :: held 1.393s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:42:11 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Created reservations ['8239dfaf-07a4-4ff5-b1f8-ce1414345da9', 'd89a79f7-da45-4be3-8d04-d51504a06b9f', 'f1e40145-b32b-4676-a993-c8a588de6d9f', 'fc87a737-faf1-4dcd-a556-c97538387db2'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:42:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:42:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:42:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:11 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:42:11 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:12 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.602s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:42:12 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Deleted volume successfully. Jun 01 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-824278c9-e509-449b-b76d-b293e08b54c4 tempest-VolumesNegativeTest-2104349246 None] Lock "cinder-14c756a3-dea5-47fa-a2a8-bab9a45f31a2-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:42:25 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=39,cinder:UPDATE=42,cinder:INSERT=8,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:42:25 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=14,cinder:INSERT=8,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Flow 'volume_create_manager' (ebeb435a-6771-4a6b-9d49-b472d5e53b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202ccf70-c401-4cf4-850f-33714bd3ea68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202ccf70-c401-4cf4-850f-33714bd3ea68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1154830833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d4d80d-ab06-4d2a-bda3-77707ccb8de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d58663e3ab40a78e4ff28e4818429d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:42:26Z,use_quota=True,user_id='6d70c8ac98654cd0b1ddc8279fb5c957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f391ef-69dd-4b92-9668-69b1b29087ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f391ef-69dd-4b92-9668-69b1b29087ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae934c18-98ae-4abf-b6fb-0924934d3c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae934c18-98ae-4abf-b6fb-0924934d3c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4d4d80d-ab06-4d2a-bda3-77707ccb8de3', 'volume_name': 'volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b6cd0c-76fb-4960-90f2-d7c1c9df3ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b6cd0c-76fb-4960-90f2-d7c1c9df3ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b333a0-e85c-4e1d-b1e6-2bb0c5c281bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:26 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Volume d4d4d80d-ab06-4d2a-bda3-77707ccb8de3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3', 'volume_size': 1} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1154830833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d4d80d-ab06-4d2a-bda3-77707ccb8de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d58663e3ab40a78e4ff28e4818429d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:42:26Z,use_quota=True,user_id='6d70c8ac98654cd0b1ddc8279fb5c957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Creating volume d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:42:26 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:42:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:26 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 1073741824 Jun 01 09:42:26 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:27 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 1073741824" returned: 0 in 0.812s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:27 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 Jun 01 09:42:27 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:27 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3" returned: 0 in 0.583s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:42:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b333a0-e85c-4e1d-b1e6-2bb0c5c281bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41a2a73-dbd0-4dfe-a27b-db886d4a2fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:27 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Volume volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 (d4d4d80d-ab06-4d2a-bda3-77707ccb8de3): created successfully Jun 01 09:42:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41a2a73-dbd0-4dfe-a27b-db886d4a2fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Flow 'volume_create_manager' (ebeb435a-6771-4a6b-9d49-b472d5e53b0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:42:27 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d0f83c7a-3eba-4953-b754-9454ababe2d5 tempest-SnapshotMetadataTestJSON-374706559 None] Created volume successfully. Jun 01 09:42:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] Creating offline snapshot 2f67faec-047b-4c3e-b1b8-8919dfbf4223 of volume d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:42:28 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8474fad-c6cc-4d90-8085-29074f577080]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:28 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 Jun 01 09:42:28 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:29 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3" returned: 0 in 0.740s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:29 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 1G Jun 01 09:42:29 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:30 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 1G" returned: 0 in 0.869s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:30 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 Jun 01 09:42:30 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:30 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223" returned: 0 in 0.692s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:30 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 is being set with open permissions: ugo+rw Jun 01 09:42:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:31 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 Jun 01 09:42:31 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:31 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223" returned: 0 in 0.649s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:31 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.info Jun 01 09:42:31 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:32 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.info" returned: 0 in 0.655s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:32 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.info is being set with open permissions: ugo+rw Jun 01 09:42:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:32 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.info Jun 01 09:42:32 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:32 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.info" returned: 0 in 0.627s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.336s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:33 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5589b593-0e05-4ca9-b1a9-d3f0bdc47946 tempest-SnapshotMetadataTestJSON-374706559 None] Create snapshot completed successfully Jun 01 09:42:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Acquiring lock "cinder-2f67faec-047b-4c3e-b1b8-8919dfbf4223-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:42:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Lock "cinder-2f67faec-047b-4c3e-b1b8-8919dfbf4223-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:42:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Acquiring lock "cinder-quobyte-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:42:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Lock "cinder-quobyte-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:42:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Acquiring lock "cinder-quobyte-2f67faec-047b-4c3e-b1b8-8919dfbf4223" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:42:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Lock "cinder-quobyte-2f67faec-047b-4c3e-b1b8-8919dfbf4223" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:42:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Deleting offline snapshot 2f67faec-047b-4c3e-b1b8-8919dfbf4223 of volume d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:42:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] snapshot_file for this snap is: volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:42:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7cf7d7-0a14-488b-95a6-191d6aee1c17]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:34 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 Jun 01 09:42:34 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:34 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Flow 'volume_create_manager' (fc9c1c33-6916-45a7-a4bb-d0b3074d74ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3177c1ce-8bdf-49b9-bc94-1f2995e12d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3177c1ce-8bdf-49b9-bc94-1f2995e12d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1678471434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cf75d4-828e-4d32-aae5-83e48eff6870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='addf85ebb14240d7890225bcbcbd82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:42:35Z,use_quota=True,user_id='648535d31fe0407b853fde6ff44015e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81842062-3d91-4b46-972b-8225cb1e5aea),volume_type_id=81842062-3d91-4b46-972b-8225cb1e5aea)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c7e394b-d813-4593-8e7b-fc87db592a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c7e394b-d813-4593-8e7b-fc87db592a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5979e394-77f6-4800-890b-9b22a426692a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5979e394-77f6-4800-890b-9b22a426692a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0cf75d4-828e-4d32-aae5-83e48eff6870', 'volume_name': 'volume-d0cf75d4-828e-4d32-aae5-83e48eff6870', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec02c027-2a41-4430-88ce-48955503d4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec02c027-2a41-4430-88ce-48955503d4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8823f06-a68b-466e-8d13-cab75a962f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:35 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Volume d0cf75d4-828e-4d32-aae5-83e48eff6870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0cf75d4-828e-4d32-aae5-83e48eff6870', 'volume_size': 1} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1678471434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cf75d4-828e-4d32-aae5-83e48eff6870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='addf85ebb14240d7890225bcbcbd82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:42:35Z,use_quota=True,user_id='648535d31fe0407b853fde6ff44015e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81842062-3d91-4b46-972b-8225cb1e5aea),volume_type_id=81842062-3d91-4b46-972b-8225cb1e5aea)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Creating volume d0cf75d4-828e-4d32-aae5-83e48eff6870 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:42:35 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:35 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870 1073741824 Jun 01 09:42:35 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Flow 'volume_create_manager' (ec9f449d-c141-4134-8cb3-8093735b88d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334cc881-4457-41d2-aea5-7871b993db40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334cc881-4457-41d2-aea5-7871b993db40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1030523889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e92512-4cbb-4daf-8ff6-5e4728680082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='addf85ebb14240d7890225bcbcbd82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:42:35Z,use_quota=True,user_id='648535d31fe0407b853fde6ff44015e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca971985-df62-4a29-ac06-c3ef19f26c2f),volume_type_id=ca971985-df62-4a29-ac06-c3ef19f26c2f)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6269c1-0b64-490f-9b60-6781895ceab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6269c1-0b64-490f-9b60-6781895ceab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350a95eb-6bf0-47c0-8073-7b62ac7844e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350a95eb-6bf0-47c0-8073-7b62ac7844e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e92512-4cbb-4daf-8ff6-5e4728680082', 'volume_name': 'volume-88e92512-4cbb-4daf-8ff6-5e4728680082', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f5be74-5f35-4333-8e64-e0b20fdb9825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f5be74-5f35-4333-8e64-e0b20fdb9825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8248c2a2-d126-450b-b810-431285674b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:35 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Volume 88e92512-4cbb-4daf-8ff6-5e4728680082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e92512-4cbb-4daf-8ff6-5e4728680082', 'volume_size': 1} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:35 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223" returned: 0 in 0.830s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfd23c2-328c-4065-9f3c-ac4ba4ab892c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:35 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 Jun 01 09:42:35 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Flow 'volume_create_manager' (4b0d6618-431e-46be-91ae-d30f7c5af22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230b645a-2b6d-4b2d-9e9a-7a493ce69ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:35 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870 1073741824" returned: 0 in 0.893s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230b645a-2b6d-4b2d-9e9a-7a493ce69ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1454524724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ecac4f5-755b-4aba-b0b3-0a4f80558e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='addf85ebb14240d7890225bcbcbd82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:42:36Z,use_quota=True,user_id='648535d31fe0407b853fde6ff44015e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b84ffa65-03b2-4e78-84cb-137a5770225a),volume_type_id=b84ffa65-03b2-4e78-84cb-137a5770225a)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f007f2d0-2618-4570-b6aa-bbeb64c734bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f007f2d0-2618-4570-b6aa-bbeb64c734bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ea998a-0e25-42f3-805f-09ff2fc938de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:36 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870 Jun 01 09:42:36 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:36 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3" returned: 0 in 0.757s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:36 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 Jun 01 09:42:36 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ea998a-0e25-42f3-805f-09ff2fc938de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ecac4f5-755b-4aba-b0b3-0a4f80558e41', 'volume_name': 'volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41', 'volume_size': 1, 'image_id': 'd4a2949f-c8bb-43ad-8480-4ddee1bccf31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4a2949f-c8bb-43ad-8480-4ddee1bccf31', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1593437926', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'addf85ebb14240d7890225bcbcbd82de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd4a2949f-c8bb-43ad-8480-4ddee1bccf31', 'created_at': datetime.datetime(2026, 6, 1, 7, 42, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4a2949f-c8bb-43ad-8480-4ddee1bccf31/file', 'properties': {}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb134706-3a69-4e05-9dc8-a359b629a6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb134706-3a69-4e05-9dc8-a359b629a6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a39363-5189-4e36-8cf8-ada3d9ff50bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Volume 6ecac4f5-755b-4aba-b0b3-0a4f80558e41: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41', 'volume_size': 1, 'image_id': 'd4a2949f-c8bb-43ad-8480-4ddee1bccf31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4a2949f-c8bb-43ad-8480-4ddee1bccf31', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1593437926', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'addf85ebb14240d7890225bcbcbd82de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd4a2949f-c8bb-43ad-8480-4ddee1bccf31', 'created_at': datetime.datetime(2026, 6, 1, 7, 42, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4a2949f-c8bb-43ad-8480-4ddee1bccf31/file', 'properties': {}}, 'image_service': } Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Trying to clone 6ecac4f5-755b-4aba-b0b3-0a4f80558e41 from image d4a2949f-c8bb-43ad-8480-4ddee1bccf31 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d4a2949f-c8bb-43ad-8480-4ddee1bccf31', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 01 09:42:36 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870" returned: 0 in 0.633s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.239s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1030523889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e92512-4cbb-4daf-8ff6-5e4728680082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='addf85ebb14240d7890225bcbcbd82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:42:35Z,use_quota=True,user_id='648535d31fe0407b853fde6ff44015e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca971985-df62-4a29-ac06-c3ef19f26c2f),volume_type_id=ca971985-df62-4a29-ac06-c3ef19f26c2f)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Creating volume 88e92512-4cbb-4daf-8ff6-5e4728680082 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:42:36 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:36 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082 1073741824 Jun 01 09:42:36 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8823f06-a68b-466e-8d13-cab75a962f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0cf75d4-828e-4d32-aae5-83e48eff6870', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe3243e-ac4e-458a-a949-e722799ae8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:36 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:42:36 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Volume volume-d0cf75d4-828e-4d32-aae5-83e48eff6870 (d0cf75d4-828e-4d32-aae5-83e48eff6870): created successfully Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe3243e-ac4e-458a-a949-e722799ae8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Flow 'volume_create_manager' (fc9c1c33-6916-45a7-a4bb-d0b3074d74ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:42:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6b3848b0-0a1e-465f-b691-902676641226 tempest-TestInstancesWithCinderVolumes-1636806809 None] Created volume successfully. Jun 01 09:42:37 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223" returned: 0 in 0.798s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:37 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223 Jun 01 09:42:37 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:37 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.679s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:42:37 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082 1073741824" returned: 0 in 0.850s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:37 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082 Jun 01 09:42:37 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:37 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3.2f67faec-047b-4c3e-b1b8-8919dfbf4223" returned: 0 in 0.632s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Lock "cinder-quobyte-2f67faec-047b-4c3e-b1b8-8919dfbf4223" released by "_delete_snapshot" :: held 3.133s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:42:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Lock "cinder-quobyte-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3" released by "delete_snapshot" :: held 3.160s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:42:37 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Created reservations ['7505a285-6069-4139-bd8d-c188ee85e403', 'd760b9fe-e006-4764-907e-e82d24ca9c8e', '644df66f-d896-4646-9d19-0b3bc72adacd', '9abde2b4-6ad5-4715-9798-e9108056df41'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:42:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Delete snapshot completed successfully. Jun 01 09:42:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa6ab510-8ff7-4615-b66c-79b50eb89840 tempest-SnapshotMetadataTestJSON-374706559 None] Lock "cinder-2f67faec-047b-4c3e-b1b8-8919dfbf4223-delete_snapshot" released by "delete_snapshot" :: held 3.317s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:42:38 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082" returned: 0 in 0.635s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:42:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8248c2a2-d126-450b-b810-431285674b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e92512-4cbb-4daf-8ff6-5e4728680082', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76865819-3e57-449d-b93e-a196d833ba18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:38 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Volume volume-88e92512-4cbb-4daf-8ff6-5e4728680082 (88e92512-4cbb-4daf-8ff6-5e4728680082): created successfully Jun 01 09:42:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76865819-3e57-449d-b93e-a196d833ba18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Flow 'volume_create_manager' (ec9f449d-c141-4134-8cb3-8093735b88d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:42:38 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d2954b34-786d-4fce-9a99-67ada377efa1 tempest-TestInstancesWithCinderVolumes-1636806809 None] Created volume successfully. Jun 01 09:42:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Acquiring lock "cinder-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:42:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Lock "cinder-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:42:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Acquiring lock "cinder-quobyte-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:42:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Lock "cinder-quobyte-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:42:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[56431bbc-f3e2-4ce9-af67-28b6f52c8d5c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:39 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 Jun 01 09:42:39 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:39 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3" returned: 0 in 0.722s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:39 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3 Jun 01 09:42:39 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:39 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_z__dg4xudevstack@QuobyteHD, size 20.69 MB, duration 3.53 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 01 09:42:39 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Image download 20.69 MB at 5.86 MB/s Jun 01 09:42:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89bd864-c9f9-4320-8dc5-8b0779daaaa6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_z__dg4xudevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:40 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_z__dg4xudevstack@QuobyteHD Jun 01 09:42:40 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:40 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3" returned: 0 in 0.594s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Lock "cinder-quobyte-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3" released by "delete_volume" :: held 1.373s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Created reservations ['8f6327ec-d69f-4915-a5df-20f6b9896d8e', '21951692-dba0-464f-aa5f-44aa832b2c3e', '4218d4a0-bd9c-4628-8196-c925a4438e86', 'b75ea459-f587-4857-ae08-535ab06be9fb'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:40 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:42:40 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:40 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_z__dg4xudevstack@QuobyteHD" returned: 0 in 0.682s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Temporary image d4a2949f-c8bb-43ad-8480-4ddee1bccf31 is fetched for user 648535d31fe0407b853fde6ff44015e1. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7b3a4f-dae2-4f38-86ce-c7a036a21733]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_z__dg4xudevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:40 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_z__dg4xudevstack@QuobyteHD Jun 01 09:42:40 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:40 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.577s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:40 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:42:40 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Deleted volume successfully. Jun 01 09:42:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-30bd5724-8af8-4cae-9ad3-4142d89eaaca tempest-SnapshotMetadataTestJSON-374706559 None] Lock "cinder-d4d4d80d-ab06-4d2a-bda3-77707ccb8de3-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:42:41 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_z__dg4xudevstack@QuobyteHD" returned: 0 in 0.657s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1454524724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ecac4f5-755b-4aba-b0b3-0a4f80558e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='addf85ebb14240d7890225bcbcbd82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:42:36Z,use_quota=True,user_id='648535d31fe0407b853fde6ff44015e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b84ffa65-03b2-4e78-84cb-137a5770225a),volume_type_id=b84ffa65-03b2-4e78-84cb-137a5770225a)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:42:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Creating volume 6ecac4f5-755b-4aba-b0b3-0a4f80558e41 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:42:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:42:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:42:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:42:41 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:42:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:41 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 1073741824 Jun 01 09:42:41 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:42 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 1073741824" returned: 0 in 0.802s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:42 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 Jun 01 09:42:42 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:42 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41" returned: 0 in 0.602s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:42:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:42 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Attempting download of d4a2949f-c8bb-43ad-8480-4ddee1bccf31 ((None, [{'url': 'file:///opt/stack/data/glance/images/d4a2949f-c8bb-43ad-8480-4ddee1bccf31', 'metadata': {}}])) to volume 6ecac4f5-755b-4aba-b0b3-0a4f80558e41. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 01 09:42:42 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbb26c9-6565-434c-941e-6c749d504699]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_ow6_pw7z {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:42 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_ow6_pw7z Jun 01 09:42:42 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:43 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_ow6_pw7z" returned: 0 in 0.697s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_ow6_pw7z {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:43 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_ow6_pw7z Jun 01 09:42:43 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:44 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_ow6_pw7z" returned: 1 in 0.716s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_ow6_pw7z' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:42:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[413b8106-8708-4bf7-af9b-268b704d576a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_z__dg4xudevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:44 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_z__dg4xudevstack@QuobyteHD Jun 01 09:42:44 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:44 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_z__dg4xudevstack@QuobyteHD" returned: 0 in 0.694s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:44 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] d4a2949f-c8bb-43ad-8480-4ddee1bccf31 was qcow2, converting to raw {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 01 09:42:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_z__dg4xudevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:44 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_z__dg4xudevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 Jun 01 09:42:44 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Flow 'volume_create_manager' (b5c8d85e-e05a-4a6a-a328-c60c6f476a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70469ab4-76d9-464d-aa67-9a54a5220128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70469ab4-76d9-464d-aa67-9a54a5220128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2008738145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7320168d-c939-49c5-b8c1-763b64d39a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85a96bf9ec34cf98dca9d8d9ae9749b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:42:46Z,use_quota=True,user_id='a22d55f0dc4c4612b429cd5b53fb8aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cf0f02-9e30-4d56-b210-3290f3491eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cf0f02-9e30-4d56-b210-3290f3491eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc03175-6563-4aba-9eda-0619204d5fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc03175-6563-4aba-9eda-0619204d5fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7320168d-c939-49c5-b8c1-763b64d39a86', 'volume_name': 'volume-7320168d-c939-49c5-b8c1-763b64d39a86', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0cead9-e1b0-4843-b969-b718f975d5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0cead9-e1b0-4843-b969-b718f975d5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122eeb1f-13ca-4520-8a45-deb2da6128d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:45 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Volume 7320168d-c939-49c5-b8c1-763b64d39a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7320168d-c939-49c5-b8c1-763b64d39a86', 'volume_size': 1} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2008738145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7320168d-c939-49c5-b8c1-763b64d39a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85a96bf9ec34cf98dca9d8d9ae9749b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:42:46Z,use_quota=True,user_id='a22d55f0dc4c4612b429cd5b53fb8aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Creating volume 7320168d-c939-49c5-b8c1-763b64d39a86 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:42:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:42:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:42:46 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:42:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:46 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 1073741824 Jun 01 09:42:46 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:46 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_z__dg4xudevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41" returned: 0 in 1.807s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:46 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d4a2949f-c8bb-43ad-8480-4ddee1bccf31_z__dg4xudevstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:42:46 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Converted 112.00 MB image at 61.94 MB/s Jun 01 09:42:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:46 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 1G Jun 01 09:42:46 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:46 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 1073741824" returned: 0 in 0.799s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:46 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 Jun 01 09:42:46 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:47 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 1G" returned: 0 in 0.628s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:47 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86" returned: 0 in 0.561s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:42:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122eeb1f-13ca-4520-8a45-deb2da6128d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7320168d-c939-49c5-b8c1-763b64d39a86', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d0bc8d-c589-47c1-b390-ba395c07dce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:47 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Volume volume-7320168d-c939-49c5-b8c1-763b64d39a86 (7320168d-c939-49c5-b8c1-763b64d39a86): created successfully Jun 01 09:42:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d0bc8d-c589-47c1-b390-ba395c07dce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Flow 'volume_create_manager' (b5c8d85e-e05a-4a6a-a328-c60c6f476a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:42:47 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09bee97-03cb-4f8b-83e4-a1410f9b3a6e]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4888f3a8-0fbe-4a6f-8c5d-14d69463c3f1 tempest-VolumesCloneTest-1925590843 None] Created volume successfully. Jun 01 09:42:47 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 Jun 01 09:42:47 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:48 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41" returned: 0 in 0.683s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:48 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 Jun 01 09:42:48 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Flow 'volume_create_manager' (bbf106ca-e21c-414d-82fe-6ea83ae83443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca5b49a-d93d-49b4-a52c-deb4a09eb85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca5b49a-d93d-49b4-a52c-deb4a09eb85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-727550287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85a96bf9ec34cf98dca9d8d9ae9749b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:42:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7320168d-c939-49c5-b8c1-763b64d39a86,status='creating',terminated_at=None,updated_at=2026-06-01T07:42:48Z,use_quota=True,user_id='a22d55f0dc4c4612b429cd5b53fb8aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e52313c-fce2-4b68-82bd-125bda8938ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e52313c-fce2-4b68-82bd-125bda8938ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16fb222-d0ab-4775-af1f-603721195383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16fb222-d0ab-4775-af1f-603721195383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8', 'volume_name': 'volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8', 'volume_size': 2, 'source_volid': '7320168d-c939-49c5-b8c1-763b64d39a86', 'source_volstatus': 'available'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99da65f-9e5f-463d-9eaa-551c6c34a8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99da65f-9e5f-463d-9eaa-551c6c34a8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb157e5-56f3-49d4-bf6b-4f9603abb752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:48 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Volume 3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8', 'volume_size': 2, 'source_volid': '7320168d-c939-49c5-b8c1-763b64d39a86', 'source_volstatus': 'available'} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:48 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Cloning volume 7320168d-c939-49c5-b8c1-763b64d39a86 to volume 3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8 Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Creating offline snapshot 8e46cba5-73aa-4f72-832f-294caaa177af of volume 7320168d-c939-49c5-b8c1-763b64d39a86 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace31bf5-b329-4da4-9d27-6682c9f27352]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:48 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 Jun 01 09:42:48 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:48 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41" returned: 1 in 0.692s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Downloaded image d4a2949f-c8bb-43ad-8480-4ddee1bccf31 ((None, [{'url': 'file:///opt/stack/data/glance/images/d4a2949f-c8bb-43ad-8480-4ddee1bccf31', 'metadata': {}}])) to volume 6ecac4f5-755b-4aba-b0b3-0a4f80558e41 successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Temporary image d4a2949f-c8bb-43ad-8480-4ddee1bccf31 for user 648535d31fe0407b853fde6ff44015e1 is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Marking volume 6ecac4f5-755b-4aba-b0b3-0a4f80558e41 as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Copying metadata from image d4a2949f-c8bb-43ad-8480-4ddee1bccf31 to 6ecac4f5-755b-4aba-b0b3-0a4f80558e41. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Creating volume glance metadata for volume 6ecac4f5-755b-4aba-b0b3-0a4f80558e41 backed by image d4a2949f-c8bb-43ad-8480-4ddee1bccf31 with: {'image_id': 'd4a2949f-c8bb-43ad-8480-4ddee1bccf31', 'image_name': 'tempest-scenario-img--1593437926', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a39363-5189-4e36-8cf8-ada3d9ff50bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41', 'volume_size': 1, 'image_id': 'd4a2949f-c8bb-43ad-8480-4ddee1bccf31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4a2949f-c8bb-43ad-8480-4ddee1bccf31', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1593437926', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'addf85ebb14240d7890225bcbcbd82de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd4a2949f-c8bb-43ad-8480-4ddee1bccf31', 'created_at': datetime.datetime(2026, 6, 1, 7, 42, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4a2949f-c8bb-43ad-8480-4ddee1bccf31/file', 'properties': {}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e74737-5702-4e11-bdc6-1b6648feca54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:42:48 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Volume volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 (6ecac4f5-755b-4aba-b0b3-0a4f80558e41): created successfully Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e74737-5702-4e11-bdc6-1b6648feca54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Flow 'volume_create_manager' (4b0d6618-431e-46be-91ae-d30f7c5af22c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:42:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-16c55651-38ea-433a-8462-a49cfc355542 tempest-TestInstancesWithCinderVolumes-1636806809 None] Created volume successfully. Jun 01 09:42:49 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86" returned: 0 in 0.700s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:49 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af 1G Jun 01 09:42:49 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:50 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af 1G" returned: 0 in 0.738s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7320168d-c939-49c5-b8c1-763b64d39a86 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:50 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7320168d-c939-49c5-b8c1-763b64d39a86 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af Jun 01 09:42:50 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:50 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7320168d-c939-49c5-b8c1-763b64d39a86 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af" returned: 0 in 0.645s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:50 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af is being set with open permissions: ugo+rw Jun 01 09:42:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:50 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af Jun 01 09:42:50 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:51 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af" returned: 0 in 0.594s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:51 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.info Jun 01 09:42:51 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:51 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.info" returned: 0 in 0.582s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:51 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.info is being set with open permissions: ugo+rw Jun 01 09:42:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:51 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.info Jun 01 09:42:51 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:52 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.info" returned: 0 in 0.589s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Acquiring lock "cinder-quobyte-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:42:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Lock "cinder-quobyte-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:42:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] snapshot: 8e46cba5-73aa-4f72-832f-294caaa177af, volume: 3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8, {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 01 09:42:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:42:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:42:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:42:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:42:52 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[009dc558-b8bc-4931-beb5-049c94f77f81]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:52 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af Jun 01 09:42:52 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:53 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af" returned: 0 in 0.692s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7320168d-c939-49c5-b8c1-763b64d39a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:42:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 01 09:42:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 01 09:42:53 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35f0650-f03d-4b1f-99d2-1e8706c6f806]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:53 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 Jun 01 09:42:53 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:53 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86" returned: 0 in 0.701s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:53 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Path /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 01 09:42:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:53 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8 Jun 01 09:42:53 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:42:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-faf13eeb-7a7d-4c5a-92ae-d9aef6d73a1a req-dea7aef7-fe20-4e04-bcd6-b3900eb41e11 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:42:59 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Jun 01 09:42:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8" returned: 0 in 5.157s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:42:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff466db9-2ebf-4f1c-aaa1-8511216d7f31]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:42:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:42:59 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 Jun 01 09:42:59 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:00 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86" returned: 0 in 0.904s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:00 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Image conversion details: src /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:43:00 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Converted 1024.00 MB image at 198.54 MB/s Jun 01 09:43:00 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8 is being set with open permissions: ugo+rw Jun 01 09:43:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:00 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8 Jun 01 09:43:00 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:00 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8" returned: 0 in 0.593s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Lock "cinder-quobyte-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8" released by "_copy_volume_from_snapshot" :: held 8.120s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Acquiring lock "cinder-quobyte-8e46cba5-73aa-4f72-832f-294caaa177af" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Lock "cinder-quobyte-8e46cba5-73aa-4f72-832f-294caaa177af" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Deleting offline snapshot 8e46cba5-73aa-4f72-832f-294caaa177af of volume 7320168d-c939-49c5-b8c1-763b64d39a86 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:43:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] snapshot_file for this snap is: volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:43:00 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[896b9ea2-71c9-4567-9935-482264d54776]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:00 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af Jun 01 09:43:00 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:01 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af" returned: 0 in 0.703s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7320168d-c939-49c5-b8c1-763b64d39a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:43:01 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7618b2d-f8bd-4393-a1c6-dd8c7cad549e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:01 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 Jun 01 09:43:01 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:02 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86" returned: 0 in 0.699s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:02 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af Jun 01 09:43:02 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:02 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af" returned: 0 in 0.703s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:02 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af Jun 01 09:43:02 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:03 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86.8e46cba5-73aa-4f72-832f-294caaa177af" returned: 0 in 0.583s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Lock "cinder-quobyte-8e46cba5-73aa-4f72-832f-294caaa177af" released by "_delete_snapshot" :: held 2.771s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.902s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-faf13eeb-7a7d-4c5a-92ae-d9aef6d73a1a req-dea7aef7-fe20-4e04-bcd6-b3900eb41e11 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.427s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb157e5-56f3-49d4-bf6b-4f9603abb752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8', 'volume_size': 2, 'source_volid': '7320168d-c939-49c5-b8c1-763b64d39a86', 'source_volstatus': 'available'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98b9a3a-54eb-4f5f-99c8-3d130fd640ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:03 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Volume volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8 (3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8): created successfully Jun 01 09:43:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98b9a3a-54eb-4f5f-99c8-3d130fd640ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Flow 'volume_create_manager' (bbf106ca-e21c-414d-82fe-6ea83ae83443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:43:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdf22a5-f0e8-46cd-968c-576a2f298841]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-faf13eeb-7a7d-4c5a-92ae-d9aef6d73a1a req-dea7aef7-fe20-4e04-bcd6-b3900eb41e11 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4567d1b1-9326-4614-8f8f-0a7697bc3a37 tempest-VolumesCloneTest-1925590843 None] Created volume successfully. Jun 01 09:43:03 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 Jun 01 09:43:03 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:04 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-faf13eeb-7a7d-4c5a-92ae-d9aef6d73a1a req-dea7aef7-fe20-4e04-bcd6-b3900eb41e11 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41" returned: 0 in 0.692s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-faf13eeb-7a7d-4c5a-92ae-d9aef6d73a1a req-dea7aef7-fe20-4e04-bcd6-b3900eb41e11 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:04 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 Jun 01 09:43:04 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Acquiring lock "cinder-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Lock "cinder-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Acquiring lock "cinder-quobyte-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Lock "cinder-quobyte-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8" acquired by "delete_volume" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfcdf5c-3142-4b51-b959-5306a281784d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:04 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8 Jun 01 09:43:04 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:04 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-faf13eeb-7a7d-4c5a-92ae-d9aef6d73a1a req-dea7aef7-fe20-4e04-bcd6-b3900eb41e11 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41" returned: 1 in 0.714s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-faf13eeb-7a7d-4c5a-92ae-d9aef6d73a1a req-dea7aef7-fe20-4e04-bcd6-b3900eb41e11 tempest-TestInstancesWithCinderVolumes-1636806809 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:43:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-faf13eeb-7a7d-4c5a-92ae-d9aef6d73a1a req-dea7aef7-fe20-4e04-bcd6-b3900eb41e11 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.456s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-faf13eeb-7a7d-4c5a-92ae-d9aef6d73a1a req-dea7aef7-fe20-4e04-bcd6-b3900eb41e11 tempest-TestInstancesWithCinderVolumes-1636806809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd07c720c-6023-41e0-8dbc-28dabfab2083', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:43:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-faf13eeb-7a7d-4c5a-92ae-d9aef6d73a1a req-dea7aef7-fe20-4e04-bcd6-b3900eb41e11 tempest-TestInstancesWithCinderVolumes-1636806809 None] attachment_update completed successfully. Jun 01 09:43:05 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8" returned: 0 in 0.695s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:05 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8 Jun 01 09:43:05 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:06 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8" returned: 0 in 0.614s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Lock "cinder-quobyte-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8" released by "delete_volume" :: held 1.353s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Created reservations ['2c4722fe-a72b-4367-81a7-6bfb353dcfd4', '01291073-6aeb-4c72-8560-85b1c9de324d', 'cdc0a21a-5b86-4346-bae6-845bb5b4a6fa', '62d0fcbb-d8bd-43cc-a80a-4ceb66548aa0'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:06 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:43:06 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:06 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.580s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:43:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Deleted volume successfully. Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09c3b812-f83a-4b59-99e8-b7a18c0fecc3 tempest-VolumesCloneTest-1925590843 None] Lock "cinder-3c6dfa44-09e5-4217-a8f7-f2460a4a0ed8-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Acquiring lock "cinder-7320168d-c939-49c5-b8c1-763b64d39a86-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Lock "cinder-7320168d-c939-49c5-b8c1-763b64d39a86-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Acquiring lock "cinder-quobyte-7320168d-c939-49c5-b8c1-763b64d39a86" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Lock "cinder-quobyte-7320168d-c939-49c5-b8c1-763b64d39a86" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:07 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d58f2d-1bff-45ba-89f6-7895c82299e9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:07 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 Jun 01 09:43:07 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:07 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86" returned: 0 in 0.707s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:07 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86 Jun 01 09:43:07 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:08 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7320168d-c939-49c5-b8c1-763b64d39a86" returned: 0 in 0.588s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Lock "cinder-quobyte-7320168d-c939-49c5-b8c1-763b64d39a86" released by "delete_volume" :: held 1.352s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Created reservations ['58066751-77c2-4bb6-9cff-14bb38aa85d6', 'c37c73d4-eab3-45e6-8f59-8d54b9450382', '6d00e838-a2d9-4873-831f-8bc7761102f1', '6652ade5-0066-4d0d-9b9d-763956e618d1'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:43:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:43:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:08 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:43:08 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:09 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.599s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:09 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:43:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Deleted volume successfully. Jun 01 09:43:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f97bd50d-ebd1-4a54-9a63-9c3714866792 tempest-VolumesCloneTest-1925590843 None] Lock "cinder-7320168d-c939-49c5-b8c1-763b64d39a86-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:12 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:43:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Flow 'volume_create_manager' (38241616-e462-40e3-a661-6a81bafd2bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:43:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73619654-1ac2-4d87-85be-be40ba7adaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73619654-1ac2-4d87-85be-be40ba7adaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-324687822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48ab4d8-dca5-45c3-b280-3af3cc3fc5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9fcab36133c430fa543e5c133a663bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:43:13Z,use_quota=True,user_id='188aba5dff5d4f649f09951bf86ad42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ef48e2-ac48-4ee9-90b1-6edbca2d168c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ef48e2-ac48-4ee9-90b1-6edbca2d168c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429e91b1-7cff-4d12-b098-30206c8e04be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:12 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 01 09:43:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429e91b1-7cff-4d12-b098-30206c8e04be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e48ab4d8-dca5-45c3-b280-3af3cc3fc5da', 'volume_name': 'volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da', 'volume_size': 1, 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e7cfcad8294f4eb88f2de87e0a453e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'created_at': datetime.datetime(2026, 6, 1, 7, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a9840a-0424-4142-89b4-785f93bc389d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a9840a-0424-4142-89b4-785f93bc389d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e97ce8-6792-477a-9a13-abcdbcdcd4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:13 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Volume e48ab4d8-dca5-45c3-b280-3af3cc3fc5da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da', 'volume_size': 1, 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e7cfcad8294f4eb88f2de87e0a453e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'created_at': datetime.datetime(2026, 6, 1, 7, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 01 09:43:13 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Trying to clone e48ab4d8-dca5-45c3-b280-3af3cc3fc5da from image c04f6c24-cff4-40fb-8629-0b2dcb859f85 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 01 09:43:13 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_kr0hzkbedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 01 09:43:13 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Image download 20.69 MB at 20.69 MB/s Jun 01 09:43:13 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[5617e43b-0848-40cc-aee9-05d3186d829e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_kr0hzkbedevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:13 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_kr0hzkbedevstack@QuobyteHD Jun 01 09:43:13 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:14 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_kr0hzkbedevstack@QuobyteHD" returned: 0 in 0.999s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:14 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Temporary image c04f6c24-cff4-40fb-8629-0b2dcb859f85 is fetched for user 188aba5dff5d4f649f09951bf86ad42c. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 01 09:43:14 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[991cc3ec-0a36-40bd-9bfb-925fa3d49ac5]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_kr0hzkbedevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:14 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_kr0hzkbedevstack@QuobyteHD Jun 01 09:43:14 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:15 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_kr0hzkbedevstack@QuobyteHD" returned: 0 in 0.740s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-324687822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48ab4d8-dca5-45c3-b280-3af3cc3fc5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9fcab36133c430fa543e5c133a663bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:43:13Z,use_quota=True,user_id='188aba5dff5d4f649f09951bf86ad42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:43:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Creating volume e48ab4d8-dca5-45c3-b280-3af3cc3fc5da {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:43:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:43:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:43:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:43:15 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:43:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:15 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da 1073741824 Jun 01 09:43:15 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:16 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da 1073741824" returned: 0 in 0.935s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:16 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da Jun 01 09:43:16 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:17 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da" returned: 0 in 0.770s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:43:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:17 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Attempting download of c04f6c24-cff4-40fb-8629-0b2dcb859f85 ((None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}])) to volume e48ab4d8-dca5-45c3-b280-3af3cc3fc5da. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 01 09:43:17 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d972416-c869-4142-bfbb-84aa1329b12b]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_da3fwcnt {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:17 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_da3fwcnt Jun 01 09:43:17 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:18 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_da3fwcnt" returned: 0 in 0.750s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_da3fwcnt {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:18 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_da3fwcnt Jun 01 09:43:18 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:18 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_da3fwcnt" returned: 1 in 0.728s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_da3fwcnt' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:43:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae6dc6b-f976-46f5-8b82-83582cab1016]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_kr0hzkbedevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:18 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_kr0hzkbedevstack@QuobyteHD Jun 01 09:43:18 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:19 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_kr0hzkbedevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:19 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] c04f6c24-cff4-40fb-8629-0b2dcb859f85 was qcow2, converting to raw {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 01 09:43:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_kr0hzkbedevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:19 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_kr0hzkbedevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da Jun 01 09:43:19 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:21 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_kr0hzkbedevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da" returned: 0 in 1.739s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:21 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85_kr0hzkbedevstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:43:21 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Converted 112.00 MB image at 64.36 MB/s Jun 01 09:43:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:21 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da 1G Jun 01 09:43:21 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:21 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da 1G" returned: 0 in 0.633s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:21 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e04e790-a41a-41a0-b301-71de31875081]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:22 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da Jun 01 09:43:22 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:22 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da" returned: 0 in 0.743s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:22 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da Jun 01 09:43:22 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:23 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da" returned: 1 in 0.738s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:43:23 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Downloaded image c04f6c24-cff4-40fb-8629-0b2dcb859f85 ((None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}])) to volume e48ab4d8-dca5-45c3-b280-3af3cc3fc5da successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 01 09:43:23 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Temporary image c04f6c24-cff4-40fb-8629-0b2dcb859f85 for user 188aba5dff5d4f649f09951bf86ad42c is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 01 09:43:23 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Marking volume e48ab4d8-dca5-45c3-b280-3af3cc3fc5da as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 01 09:43:23 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Copying metadata from image c04f6c24-cff4-40fb-8629-0b2dcb859f85 to e48ab4d8-dca5-45c3-b280-3af3cc3fc5da. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 01 09:43:23 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Creating volume glance metadata for volume e48ab4d8-dca5-45c3-b280-3af3cc3fc5da backed by image c04f6c24-cff4-40fb-8629-0b2dcb859f85 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 01 09:43:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e97ce8-6792-477a-9a13-abcdbcdcd4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da', 'volume_size': 1, 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e7cfcad8294f4eb88f2de87e0a453e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'created_at': datetime.datetime(2026, 6, 1, 7, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10469f43-9e40-4559-934c-ea9a46be2563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:23 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Volume volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da (e48ab4d8-dca5-45c3-b280-3af3cc3fc5da): created successfully Jun 01 09:43:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10469f43-9e40-4559-934c-ea9a46be2563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Flow 'volume_create_manager' (38241616-e462-40e3-a661-6a81bafd2bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:43:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9a7bd2e9-6005-40ea-b7bf-8c5b991d6f7e tempest-VolumesExtendTest-458112602 None] Created volume successfully. Jun 01 09:43:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dac2a7e4-dded-4850-b842-18a97a622a7a tempest-VolumesExtendTest-458112602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dac2a7e4-dded-4850-b842-18a97a622a7a tempest-VolumesExtendTest-458112602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:24 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[884703c0-a4c3-43da-8dd9-72ffd3368a24]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dac2a7e4-dded-4850-b842-18a97a622a7a tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:24 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da Jun 01 09:43:24 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:25 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dac2a7e4-dded-4850-b842-18a97a622a7a tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da" returned: 0 in 0.744s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dac2a7e4-dded-4850-b842-18a97a622a7a tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:25 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da Jun 01 09:43:25 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:26 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dac2a7e4-dded-4850-b842-18a97a622a7a tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da" returned: 1 in 0.766s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dac2a7e4-dded-4850-b842-18a97a622a7a tempest-VolumesExtendTest-458112602 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:43:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dac2a7e4-dded-4850-b842-18a97a622a7a tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da 2G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dac2a7e4-dded-4850-b842-18a97a622a7a tempest-VolumesExtendTest-458112602 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da 2G" returned: 0 in 0.078s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dac2a7e4-dded-4850-b842-18a97a622a7a tempest-VolumesExtendTest-458112602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.642s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:26 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=58,cinder:SELECT=57,cinder:DELETE=6,cinder:INSERT=25 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:43:26 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=64,cinder:UPDATE=58,cinder:INSERT=23,cinder:DELETE=5 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:43:26 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-dac2a7e4-dded-4850-b842-18a97a622a7a tempest-VolumesExtendTest-458112602 None] Extend volume completed successfully. Jun 01 09:43:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Acquiring lock "cinder-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Lock "cinder-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Acquiring lock "cinder-quobyte-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Lock "cinder-quobyte-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:27 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cccb55-10bf-4101-aabc-d0dad37ec7ab]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:27 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da Jun 01 09:43:27 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:27 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da" returned: 0 in 0.683s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:28 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da Jun 01 09:43:28 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:28 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da" returned: 1 in 0.688s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:43:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:28 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da Jun 01 09:43:28 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:29 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da" returned: 0 in 0.569s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Lock "cinder-quobyte-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da" released by "delete_volume" :: held 2.000s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:29 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Created reservations ['1e8dd1e1-3fca-4823-9cb8-6fbcff1b05a4', '01b16c31-e781-4473-92a5-2d7b4b8bd46e', '7bab3c73-82ca-44c2-a31f-9b0805db9142', 'b89a9e5b-8eee-4d13-888b-9a0dcdb1efca'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:43:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:43:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:43:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:29 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:43:29 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:29 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.577s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:29 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:43:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Deleted volume successfully. Jun 01 09:43:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-069e32fe-c02a-44e8-8109-b581df4eaeee tempest-VolumesExtendTest-458112602 None] Lock "cinder-e48ab4d8-dca5-45c3-b280-3af3cc3fc5da-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Flow 'volume_create_manager' (dbd802bc-0c82-49d3-93c4-061369d2eff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd624534-9952-4bf7-8baf-95911b49cfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd624534-9952-4bf7-8baf-95911b49cfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1735285521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f641a385-2c03-4d33-8602-a2e3673cd426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9fcab36133c430fa543e5c133a663bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:43:31Z,use_quota=True,user_id='188aba5dff5d4f649f09951bf86ad42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11916bc4-3f89-4e93-a093-c7850fff3914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11916bc4-3f89-4e93-a093-c7850fff3914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c39ec7-b44e-4775-b810-eb19083837f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c39ec7-b44e-4775-b810-eb19083837f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f641a385-2c03-4d33-8602-a2e3673cd426', 'volume_name': 'volume-f641a385-2c03-4d33-8602-a2e3673cd426', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b09f320-387c-430d-8535-8eaf267289b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b09f320-387c-430d-8535-8eaf267289b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88170cb2-5a9d-4e62-bdb9-970de84162ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:30 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Volume f641a385-2c03-4d33-8602-a2e3673cd426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f641a385-2c03-4d33-8602-a2e3673cd426', 'volume_size': 1} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1735285521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f641a385-2c03-4d33-8602-a2e3673cd426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9fcab36133c430fa543e5c133a663bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:43:31Z,use_quota=True,user_id='188aba5dff5d4f649f09951bf86ad42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Creating volume f641a385-2c03-4d33-8602-a2e3673cd426 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:43:30 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:43:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:30 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 1073741824 Jun 01 09:43:30 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:31 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 1073741824" returned: 0 in 0.752s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:31 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 Jun 01 09:43:31 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:32 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426" returned: 0 in 0.588s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:43:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88170cb2-5a9d-4e62-bdb9-970de84162ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f641a385-2c03-4d33-8602-a2e3673cd426', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17ef010-57fc-4da2-aac1-9d54816f8d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:32 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Volume volume-f641a385-2c03-4d33-8602-a2e3673cd426 (f641a385-2c03-4d33-8602-a2e3673cd426): created successfully Jun 01 09:43:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17ef010-57fc-4da2-aac1-9d54816f8d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Flow 'volume_create_manager' (dbd802bc-0c82-49d3-93c4-061369d2eff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:43:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9653a701-a2c2-4c51-9692-d3d519c67f37 tempest-VolumesExtendTest-458112602 None] Created volume successfully. Jun 01 09:43:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] Creating offline snapshot 0b4d429c-a10c-46fb-94b9-ac2de009952f of volume f641a385-2c03-4d33-8602-a2e3673cd426 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:43:33 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea41996a-d21b-4959-b0fe-a73034af5099]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:33 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 Jun 01 09:43:33 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:33 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426" returned: 0 in 0.761s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:33 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f 1G Jun 01 09:43:33 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:34 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f 1G" returned: 0 in 0.738s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f641a385-2c03-4d33-8602-a2e3673cd426 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:34 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f641a385-2c03-4d33-8602-a2e3673cd426 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f Jun 01 09:43:34 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:35 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f641a385-2c03-4d33-8602-a2e3673cd426 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f" returned: 0 in 0.641s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:35 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f is being set with open permissions: ugo+rw Jun 01 09:43:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:35 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f Jun 01 09:43:35 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:35 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f" returned: 0 in 0.572s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:35 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.info Jun 01 09:43:35 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:36 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.info" returned: 0 in 0.578s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:36 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.info is being set with open permissions: ugo+rw Jun 01 09:43:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:36 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.info Jun 01 09:43:36 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:43:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:43:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:43:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:36 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:43:36 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:36 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.info" returned: 0 in 0.583s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.960s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ce8a83e2-3c4b-4ae7-b82d-5cf1dffa9b20 tempest-VolumesExtendTest-458112602 None] Create snapshot completed successfully Jun 01 09:43:37 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.601s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:43:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2f147bf-7023-4ae8-ba4b-534395cbf4f0 tempest-VolumesExtendTest-458112602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2f147bf-7023-4ae8-ba4b-534395cbf4f0 tempest-VolumesExtendTest-458112602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d159a823-dbff-4821-a009-fe30698e8392]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2f147bf-7023-4ae8-ba4b-534395cbf4f0 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:37 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 Jun 01 09:43:37 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:38 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2f147bf-7023-4ae8-ba4b-534395cbf4f0 tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426" returned: 0 in 0.698s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2f147bf-7023-4ae8-ba4b-534395cbf4f0 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f 2G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2f147bf-7023-4ae8-ba4b-534395cbf4f0 tempest-VolumesExtendTest-458112602 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f 2G" returned: 0 in 0.119s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2f147bf-7023-4ae8-ba4b-534395cbf4f0 tempest-VolumesExtendTest-458112602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.849s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:38 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d2f147bf-7023-4ae8-ba4b-534395cbf4f0 tempest-VolumesExtendTest-458112602 None] Extend volume completed successfully. Jun 01 09:43:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Acquiring lock "cinder-0b4d429c-a10c-46fb-94b9-ac2de009952f-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Lock "cinder-0b4d429c-a10c-46fb-94b9-ac2de009952f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Acquiring lock "cinder-quobyte-f641a385-2c03-4d33-8602-a2e3673cd426" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Lock "cinder-quobyte-f641a385-2c03-4d33-8602-a2e3673cd426" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Acquiring lock "cinder-quobyte-0b4d429c-a10c-46fb-94b9-ac2de009952f" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Lock "cinder-quobyte-0b4d429c-a10c-46fb-94b9-ac2de009952f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Deleting offline snapshot 0b4d429c-a10c-46fb-94b9-ac2de009952f of volume f641a385-2c03-4d33-8602-a2e3673cd426 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:43:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] snapshot_file for this snap is: volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:43:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae52dcf6-6a7c-4878-ba25-91e389ea292e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:38 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f Jun 01 09:43:38 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:39 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f" returned: 0 in 0.696s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f641a385-2c03-4d33-8602-a2e3673cd426(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:43:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[147cc1f2-b0ec-47bf-ac1a-cd34c1d2bfe9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:39 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 Jun 01 09:43:39 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:40 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426" returned: 0 in 0.685s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:40 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f Jun 01 09:43:40 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:40 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f" returned: 0 in 0.688s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:40 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f Jun 01 09:43:40 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:41 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426.0b4d429c-a10c-46fb-94b9-ac2de009952f" returned: 0 in 0.626s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Lock "cinder-quobyte-0b4d429c-a10c-46fb-94b9-ac2de009952f" released by "_delete_snapshot" :: held 2.793s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Lock "cinder-quobyte-f641a385-2c03-4d33-8602-a2e3673cd426" released by "delete_snapshot" :: held 2.813s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:41 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Created reservations ['18ce8963-98c5-4bf2-a54e-42d2e086df32', '68147ea6-efd7-4b8a-8c37-47833a20ccee', 'd882df2d-ccec-4e0c-8510-b79ca788bc22', '9987e8c8-037f-4f84-8a47-be6677094010'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:43:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Delete snapshot completed successfully. Jun 01 09:43:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b00d4f4-9a64-4da0-bf12-8bc59df901d8 tempest-VolumesExtendTest-458112602 None] Lock "cinder-0b4d429c-a10c-46fb-94b9-ac2de009952f-delete_snapshot" released by "delete_snapshot" :: held 2.942s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Acquiring lock "cinder-f641a385-2c03-4d33-8602-a2e3673cd426-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Lock "cinder-f641a385-2c03-4d33-8602-a2e3673cd426-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Acquiring lock "cinder-quobyte-f641a385-2c03-4d33-8602-a2e3673cd426" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Lock "cinder-quobyte-f641a385-2c03-4d33-8602-a2e3673cd426" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25b1b63-abda-4a07-8649-d4d454eefb47]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:42 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 Jun 01 09:43:42 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-6437c733-a347-40f3-8d02-62b72ba75271 req-0f33941f-9d3a-47dc-a9d7-e1a12f3b07c5 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-6437c733-a347-40f3-8d02-62b72ba75271 req-0f33941f-9d3a-47dc-a9d7-e1a12f3b07c5 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:42 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cdc1ae-05d7-48f4-9647-cbc790e07718]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-6437c733-a347-40f3-8d02-62b72ba75271 req-0f33941f-9d3a-47dc-a9d7-e1a12f3b07c5 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:42 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870 Jun 01 09:43:42 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:42 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426" returned: 0 in 0.714s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:42 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426 Jun 01 09:43:42 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:42 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-6437c733-a347-40f3-8d02-62b72ba75271 req-0f33941f-9d3a-47dc-a9d7-e1a12f3b07c5 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870" returned: 0 in 0.704s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-6437c733-a347-40f3-8d02-62b72ba75271 req-0f33941f-9d3a-47dc-a9d7-e1a12f3b07c5 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.720s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-6437c733-a347-40f3-8d02-62b72ba75271 req-0f33941f-9d3a-47dc-a9d7-e1a12f3b07c5 tempest-TestInstancesWithCinderVolumes-1636806809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-d0cf75d4-828e-4d32-aae5-83e48eff6870', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03f9ebc4-db89-43ef-b6e7-2bcb2bb1498a', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:43:42 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-6437c733-a347-40f3-8d02-62b72ba75271 req-0f33941f-9d3a-47dc-a9d7-e1a12f3b07c5 tempest-TestInstancesWithCinderVolumes-1636806809 None] attachment_update completed successfully. Jun 01 09:43:43 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f641a385-2c03-4d33-8602-a2e3673cd426" returned: 0 in 0.606s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Lock "cinder-quobyte-f641a385-2c03-4d33-8602-a2e3673cd426" released by "delete_volume" :: held 1.377s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Created reservations ['26e67467-79b9-490b-aa5b-8ca1f697ac9a', '71b30084-7bcb-4fda-b8d0-b883dec3f52e', '0807b3b5-a6e1-42a7-803c-3802977713db', 'd3735fd1-456d-4d25-a10d-97d91c6abd48'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:43:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:43:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:43 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:43:43 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:43 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.601s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:43:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Deleted volume successfully. Jun 01 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e88789e1-dd1e-4e96-a60e-20dcd31b7cf5 tempest-VolumesExtendTest-458112602 None] Lock "cinder-f641a385-2c03-4d33-8602-a2e3673cd426-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Flow 'volume_create_manager' (905e3166-b209-4040-b6a9-31ed0b2a14ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ed708e-78cf-4253-9c48-e6ed92340f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ed708e-78cf-4253-9c48-e6ed92340f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-237851475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d699d4-195a-4e2d-96dd-6693798f6b6e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2c0dd96306348b7b26f0c50a2993152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:43:46Z,use_quota=True,user_id='6537c6e3c00c4d2f9f92ae03cde8983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb7845b-077e-427d-b66c-5d420e8e0966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb7845b-077e-427d-b66c-5d420e8e0966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb69e70-0ebc-4660-a427-ad1ea2aabe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb69e70-0ebc-4660-a427-ad1ea2aabe3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37d699d4-195a-4e2d-96dd-6693798f6b6e', 'volume_name': 'volume-37d699d4-195a-4e2d-96dd-6693798f6b6e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289ad71f-315b-4742-9d07-6380a163305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289ad71f-315b-4742-9d07-6380a163305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e836f72-17b2-4b47-9bec-2f77858a85e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:46 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Volume 37d699d4-195a-4e2d-96dd-6693798f6b6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37d699d4-195a-4e2d-96dd-6693798f6b6e', 'volume_size': 1} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-237851475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d699d4-195a-4e2d-96dd-6693798f6b6e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2c0dd96306348b7b26f0c50a2993152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:43:46Z,use_quota=True,user_id='6537c6e3c00c4d2f9f92ae03cde8983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Creating volume 37d699d4-195a-4e2d-96dd-6693798f6b6e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:43:46 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:43:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-37d699d4-195a-4e2d-96dd-6693798f6b6e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:46 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-37d699d4-195a-4e2d-96dd-6693798f6b6e 1073741824 Jun 01 09:43:46 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:47 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-37d699d4-195a-4e2d-96dd-6693798f6b6e 1073741824" returned: 0 in 0.805s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-37d699d4-195a-4e2d-96dd-6693798f6b6e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:47 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-37d699d4-195a-4e2d-96dd-6693798f6b6e Jun 01 09:43:47 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:48 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-37d699d4-195a-4e2d-96dd-6693798f6b6e" returned: 0 in 0.577s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:43:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e836f72-17b2-4b47-9bec-2f77858a85e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37d699d4-195a-4e2d-96dd-6693798f6b6e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f42b58a-3cc8-47de-b021-ede6c95ade6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:48 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Volume volume-37d699d4-195a-4e2d-96dd-6693798f6b6e (37d699d4-195a-4e2d-96dd-6693798f6b6e): created successfully Jun 01 09:43:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f42b58a-3cc8-47de-b021-ede6c95ade6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Flow 'volume_create_manager' (905e3166-b209-4040-b6a9-31ed0b2a14ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:43:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-74cff905-e887-4c6d-a982-d29cec308b7d tempest-VolumesGetTest-642626030 None] Created volume successfully. Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Flow 'volume_create_manager' (b275d497-7b02-493e-9c45-9a6f3751e86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57aa507-2b66-43ce-9f6b-ae12f64461ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57aa507-2b66-43ce-9f6b-ae12f64461ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:43:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1521518241',display_name='tempest-VolumesGetTest-Volume-2001992056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32938c1b-863d-448f-92b8-b2437e3760b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c0dd96306348b7b26f0c50a2993152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:43:49Z,use_quota=True,user_id='6537c6e3c00c4d2f9f92ae03cde8983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be863ce-acf9-4678-a17c-c19f2a31e8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be863ce-acf9-4678-a17c-c19f2a31e8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ea19f5-860e-4f5d-b4bf-8e3edb7f49d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ea19f5-860e-4f5d-b4bf-8e3edb7f49d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32938c1b-863d-448f-92b8-b2437e3760b6', 'volume_name': 'volume-32938c1b-863d-448f-92b8-b2437e3760b6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a825ea-c6f3-41f3-934d-2230e8e64df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a825ea-c6f3-41f3-934d-2230e8e64df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49164d4b-d408-4246-bbe3-9f9927b7972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:49 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Volume 32938c1b-863d-448f-92b8-b2437e3760b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32938c1b-863d-448f-92b8-b2437e3760b6', 'volume_size': 1} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:43:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1521518241',display_name='tempest-VolumesGetTest-Volume-2001992056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32938c1b-863d-448f-92b8-b2437e3760b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c0dd96306348b7b26f0c50a2993152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:43:49Z,use_quota=True,user_id='6537c6e3c00c4d2f9f92ae03cde8983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Creating volume 32938c1b-863d-448f-92b8-b2437e3760b6 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:43:49 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:43:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-32938c1b-863d-448f-92b8-b2437e3760b6 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:49 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-32938c1b-863d-448f-92b8-b2437e3760b6 1073741824 Jun 01 09:43:49 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:50 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-32938c1b-863d-448f-92b8-b2437e3760b6 1073741824" returned: 0 in 0.804s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-ba31e18b-6b8a-4aa4-a4f4-db2b2942bc17 req-b0dce3b2-0321-4c9d-936b-7ec913e4c499 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-32938c1b-863d-448f-92b8-b2437e3760b6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:50 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-32938c1b-863d-448f-92b8-b2437e3760b6 Jun 01 09:43:50 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:50 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-32938c1b-863d-448f-92b8-b2437e3760b6" returned: 0 in 0.587s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:43:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-ba31e18b-6b8a-4aa4-a4f4-db2b2942bc17 req-b0dce3b2-0321-4c9d-936b-7ec913e4c499 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.601s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49164d4b-d408-4246-bbe3-9f9927b7972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32938c1b-863d-448f-92b8-b2437e3760b6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e325a7c2-f557-4e9f-992f-2f52ab7beb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a3db9f-ae96-48f3-9bd4-c4c3063c6911]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-ba31e18b-6b8a-4aa4-a4f4-db2b2942bc17 req-b0dce3b2-0321-4c9d-936b-7ec913e4c499 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:50 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Volume volume-32938c1b-863d-448f-92b8-b2437e3760b6 (32938c1b-863d-448f-92b8-b2437e3760b6): created successfully Jun 01 09:43:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e325a7c2-f557-4e9f-992f-2f52ab7beb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Flow 'volume_create_manager' (b275d497-7b02-493e-9c45-9a6f3751e86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:43:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6b6c91dc-e8bc-45be-8a15-b8aff8b980eb tempest-VolumesGetTest-642626030 None] Created volume successfully. Jun 01 09:43:50 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082 Jun 01 09:43:50 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-32938c1b-863d-448f-92b8-b2437e3760b6-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:51 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-ba31e18b-6b8a-4aa4-a4f4-db2b2942bc17 req-b0dce3b2-0321-4c9d-936b-7ec913e4c499 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082" returned: 0 in 0.713s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-ba31e18b-6b8a-4aa4-a4f4-db2b2942bc17 req-b0dce3b2-0321-4c9d-936b-7ec913e4c499 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.741s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Lock "cinder-32938c1b-863d-448f-92b8-b2437e3760b6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-quobyte-32938c1b-863d-448f-92b8-b2437e3760b6" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-32938c1b-863d-448f-92b8-b2437e3760b6" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-ba31e18b-6b8a-4aa4-a4f4-db2b2942bc17 req-b0dce3b2-0321-4c9d-936b-7ec913e4c499 tempest-TestInstancesWithCinderVolumes-1636806809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-88e92512-4cbb-4daf-8ff6-5e4728680082', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b63b3a19-00d4-4a4c-a53b-7859111c13b9', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:43:51 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e9ba6a-2f20-4281-8ef2-65946767af51]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-32938c1b-863d-448f-92b8-b2437e3760b6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-ba31e18b-6b8a-4aa4-a4f4-db2b2942bc17 req-b0dce3b2-0321-4c9d-936b-7ec913e4c499 tempest-TestInstancesWithCinderVolumes-1636806809 None] attachment_update completed successfully. Jun 01 09:43:51 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-32938c1b-863d-448f-92b8-b2437e3760b6 Jun 01 09:43:51 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:52 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-32938c1b-863d-448f-92b8-b2437e3760b6" returned: 0 in 0.707s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-32938c1b-863d-448f-92b8-b2437e3760b6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:52 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-32938c1b-863d-448f-92b8-b2437e3760b6 Jun 01 09:43:52 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:52 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-32938c1b-863d-448f-92b8-b2437e3760b6" returned: 0 in 0.585s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-32938c1b-863d-448f-92b8-b2437e3760b6" released by "delete_volume" :: held 1.343s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:52 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Created reservations ['6b4f8d12-79b1-4f7e-af23-5ae44f433772', 'ef7c6470-d0c2-4b47-a8f7-40214082bb47', '223c8fcc-06f3-4c55-a603-61da496f1d83', 'f8c4bb16-7ea6-40a6-bec9-31137ac55003'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:43:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:43:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:43:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:52 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:43:52 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:53 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.588s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:53 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:43:53 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Deleted volume successfully. Jun 01 09:43:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c3136fed-f959-4051-9e48-a0d9c9d27877 tempest-VolumesGetTest-642626030 None] Lock "cinder-32938c1b-863d-448f-92b8-b2437e3760b6-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-37d699d4-195a-4e2d-96dd-6693798f6b6e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Lock "cinder-37d699d4-195a-4e2d-96dd-6693798f6b6e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-quobyte-37d699d4-195a-4e2d-96dd-6693798f6b6e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:43:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-37d699d4-195a-4e2d-96dd-6693798f6b6e" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:43:53 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[014d970b-0e57-4a65-b42a-9981c8f4b6f9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-37d699d4-195a-4e2d-96dd-6693798f6b6e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:53 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-37d699d4-195a-4e2d-96dd-6693798f6b6e Jun 01 09:43:53 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:54 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-37d699d4-195a-4e2d-96dd-6693798f6b6e" returned: 0 in 0.704s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-37d699d4-195a-4e2d-96dd-6693798f6b6e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:54 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-37d699d4-195a-4e2d-96dd-6693798f6b6e Jun 01 09:43:54 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:55 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-37d699d4-195a-4e2d-96dd-6693798f6b6e" returned: 0 in 0.605s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-37d699d4-195a-4e2d-96dd-6693798f6b6e" released by "delete_volume" :: held 1.350s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:55 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Created reservations ['b4d0e6ee-c1c9-442e-bf7e-490825a7fddc', 'b76477f2-97df-42ee-b45e-a0083a5cc033', '7a64eb98-ce14-4c2c-8470-95ed08bd38e6', 'e0218d58-85c7-4f70-921a-09639fa1c5ce'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:43:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:43:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:43:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:55 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:43:55 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:55 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.600s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:55 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:43:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Deleted volume successfully. Jun 01 09:43:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a26dd5a9-452e-449e-8b31-46034037246d tempest-VolumesGetTest-642626030 None] Lock "cinder-37d699d4-195a-4e2d-96dd-6693798f6b6e-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Flow 'volume_create_manager' (53160a78-e2eb-410b-8407-be5f25ddf2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7513e29c-684f-483f-8fe0-c34590a7c35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7513e29c-684f-483f-8fe0-c34590a7c35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1584248900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d131987-97f2-4a22-aae0-985c6e289d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c0dd96306348b7b26f0c50a2993152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:43:56Z,use_quota=True,user_id='6537c6e3c00c4d2f9f92ae03cde8983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbafddfb-0319-4884-be47-22df170f4464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbafddfb-0319-4884-be47-22df170f4464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae07a01-6300-40c6-bca8-b4e4c14a8480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae07a01-6300-40c6-bca8-b4e4c14a8480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d131987-97f2-4a22-aae0-985c6e289d6f', 'volume_name': 'volume-9d131987-97f2-4a22-aae0-985c6e289d6f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d648995-0bad-46d1-b0f4-c05e5dcfba0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d648995-0bad-46d1-b0f4-c05e5dcfba0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c09031-1cf9-4bb3-8dfb-329d024f04cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:56 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Volume 9d131987-97f2-4a22-aae0-985c6e289d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d131987-97f2-4a22-aae0-985c6e289d6f', 'volume_size': 1} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1584248900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d131987-97f2-4a22-aae0-985c6e289d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c0dd96306348b7b26f0c50a2993152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:43:56Z,use_quota=True,user_id='6537c6e3c00c4d2f9f92ae03cde8983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Creating volume 9d131987-97f2-4a22-aae0-985c6e289d6f {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:43:56 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:43:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:56 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f 1073741824 Jun 01 09:43:56 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:57 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f 1073741824" returned: 0 in 0.839s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:57 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f Jun 01 09:43:57 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:57 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f" returned: 0 in 0.619s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:43:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:43:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c09031-1cf9-4bb3-8dfb-329d024f04cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d131987-97f2-4a22-aae0-985c6e289d6f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d54b48d-e477-49ea-9bd1-bf9d81cd07f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:57 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Volume volume-9d131987-97f2-4a22-aae0-985c6e289d6f (9d131987-97f2-4a22-aae0-985c6e289d6f): created successfully Jun 01 09:43:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d54b48d-e477-49ea-9bd1-bf9d81cd07f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Flow 'volume_create_manager' (53160a78-e2eb-410b-8407-be5f25ddf2df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:43:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f6bdd99b-0b01-4a36-9454-0ab24035fbb9 tempest-VolumesGetTest-642626030 None] Created volume successfully. Jun 01 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Flow 'volume_create_manager' (c8009cac-b300-4ec4-8cab-2e93a1d8a0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0ef94d-ec82-4d39-b106-07a3a4e1de88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0ef94d-ec82-4d39-b106-07a3a4e1de88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1511727749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9215527b-3eb6-4722-a82d-3807a65b8c6d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2c0dd96306348b7b26f0c50a2993152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9d131987-97f2-4a22-aae0-985c6e289d6f,status='creating',terminated_at=None,updated_at=2026-06-01T07:43:59Z,use_quota=True,user_id='6537c6e3c00c4d2f9f92ae03cde8983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ecb5879-0cde-4a87-be68-170ed4599938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ecb5879-0cde-4a87-be68-170ed4599938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15bbced7-77d1-4c15-b356-dd25bacd4273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15bbced7-77d1-4c15-b356-dd25bacd4273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9215527b-3eb6-4722-a82d-3807a65b8c6d', 'volume_name': 'volume-9215527b-3eb6-4722-a82d-3807a65b8c6d', 'volume_size': 1, 'source_volid': '9d131987-97f2-4a22-aae0-985c6e289d6f', 'source_volstatus': 'available'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e650344-4029-4d6a-be09-5c153b3847d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e650344-4029-4d6a-be09-5c153b3847d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca2500e-1541-4cee-a5fa-2f94deac3987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:43:58 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Volume 9215527b-3eb6-4722-a82d-3807a65b8c6d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9215527b-3eb6-4722-a82d-3807a65b8c6d', 'volume_size': 1, 'source_volid': '9d131987-97f2-4a22-aae0-985c6e289d6f', 'source_volstatus': 'available'} Jun 01 09:43:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:43:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:43:58 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Cloning volume 9d131987-97f2-4a22-aae0-985c6e289d6f to volume 9215527b-3eb6-4722-a82d-3807a65b8c6d Jun 01 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Creating offline snapshot 39fdef0d-ae4d-4664-b3bb-c33741083bed of volume 9d131987-97f2-4a22-aae0-985c6e289d6f {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:43:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[48857775-69ec-4b7a-b878-d9f4307a2c6e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:43:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:59 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f Jun 01 09:43:59 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:43:59 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Jun 01 09:43:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f" returned: 0 in 0.693s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:43:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:43:59 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed 1G Jun 01 09:43:59 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-c6da8634-f10b-4fe9-a320-9719914c3b07 req-f8a09523-04ce-4d3a-a1e9-cf508e440f13 tempest-TestInstancesWithCinderVolumes-1636806809 None] Terminate volume connection completed successfully. Jun 01 09:44:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-c6da8634-f10b-4fe9-a320-9719914c3b07 req-f8a09523-04ce-4d3a-a1e9-cf508e440f13 tempest-TestInstancesWithCinderVolumes-1636806809 None] Deleting attachment 03f9ebc4-db89-43ef-b6e7-2bcb2bb1498a. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:44:00 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed 1G" returned: 0 in 0.765s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d131987-97f2-4a22-aae0-985c6e289d6f -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:00 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d131987-97f2-4a22-aae0-985c6e289d6f -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed Jun 01 09:44:00 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:01 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d131987-97f2-4a22-aae0-985c6e289d6f -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed" returned: 0 in 0.630s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:01 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed is being set with open permissions: ugo+rw Jun 01 09:44:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:01 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed Jun 01 09:44:01 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:01 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed" returned: 0 in 0.573s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:01 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.info Jun 01 09:44:01 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:02 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.info" returned: 0 in 0.590s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:02 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.info is being set with open permissions: ugo+rw Jun 01 09:44:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:02 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.info Jun 01 09:44:02 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "cinder-d0cf75d4-828e-4d32-aae5-83e48eff6870-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "cinder-d0cf75d4-828e-4d32-aae5-83e48eff6870-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "cinder-quobyte-d0cf75d4-828e-4d32-aae5-83e48eff6870" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "cinder-quobyte-d0cf75d4-828e-4d32-aae5-83e48eff6870" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:02 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c8b6c1-1db2-4de4-aa8b-8167abdd82f8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:02 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870 Jun 01 09:44:02 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:02 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.info" returned: 0 in 0.652s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-quobyte-9215527b-3eb6-4722-a82d-3807a65b8c6d" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-9215527b-3eb6-4722-a82d-3807a65b8c6d" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] snapshot: 39fdef0d-ae4d-4664-b3bb-c33741083bed, volume: 9215527b-3eb6-4722-a82d-3807a65b8c6d, {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6541dae-fb87-4b36-81f7-6f1309febf5e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:03 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed Jun 01 09:44:03 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:03 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870" returned: 0 in 0.760s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:03 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870 Jun 01 09:44:03 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:03 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed" returned: 0 in 0.753s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d131987-97f2-4a22-aae0-985c6e289d6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7664bb-c4c2-492d-b526-10b97cfec384]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:03 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d0cf75d4-828e-4d32-aae5-83e48eff6870" returned: 0 in 0.624s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "cinder-quobyte-d0cf75d4-828e-4d32-aae5-83e48eff6870" released by "delete_volume" :: held 1.434s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:03 devstack cinder-volume[86649]: WARNING cinder.quota [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-430900121-1638473177 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-430900121-1638473177, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:44:03 devstack cinder-volume[86649]: WARNING cinder.quota [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-430900121-1638473177 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-430900121-1638473177, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Created reservations ['35b206eb-d0d6-4f30-85e6-90112644142f', '9ebe6d07-7a79-42c3-8bb4-bc5e527210fa', 'ac881068-c430-45ad-83c5-97886079793f', '598ecc5f-300c-429a-932a-5ec950104fdb'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:44:03 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f Jun 01 09:44:03 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:04 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:44:04 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:04 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f" returned: 0 in 0.745s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:04 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Path /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 01 09:44:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:04 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d Jun 01 09:44:04 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:04 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.617s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:04 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:44:04 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Deleted volume successfully. Jun 01 09:44:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19d88f29-73fb-4a1a-92db-0d0b7d1292d2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "cinder-d0cf75d4-828e-4d32-aae5-83e48eff6870-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:07 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-87acd42f-607f-440d-9d03-5baa8c78d3ae req-d07e6b24-d850-4aef-aa15-cf4a2d8ad4a2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Terminate volume connection completed successfully. Jun 01 09:44:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-87acd42f-607f-440d-9d03-5baa8c78d3ae req-d07e6b24-d850-4aef-aa15-cf4a2d8ad4a2 tempest-TestInstancesWithCinderVolumes-1636806809 None] Deleting attachment b63b3a19-00d4-4a4c-a53b-7859111c13b9. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:44:09 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d" returned: 0 in 4.666s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2003b384-4240-41b2-8ed4-645838a573cd]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:09 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f Jun 01 09:44:09 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "cinder-88e92512-4cbb-4daf-8ff6-5e4728680082-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "cinder-88e92512-4cbb-4daf-8ff6-5e4728680082-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "cinder-quobyte-88e92512-4cbb-4daf-8ff6-5e4728680082" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "cinder-quobyte-88e92512-4cbb-4daf-8ff6-5e4728680082" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[878fe30d-da15-4a0e-a8b5-f43c24295e9e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:09 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082 Jun 01 09:44:09 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:10 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f" returned: 0 in 0.921s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Image conversion details: src /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f, size 1024.00 MB, duration 4.67 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:44:10 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Converted 1024.00 MB image at 219.40 MB/s Jun 01 09:44:10 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d is being set with open permissions: ugo+rw Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:10 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d Jun 01 09:44:10 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:10 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082" returned: 0 in 0.720s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:10 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082 Jun 01 09:44:10 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:10 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d" returned: 0 in 0.668s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-9215527b-3eb6-4722-a82d-3807a65b8c6d" released by "_copy_volume_from_snapshot" :: held 7.850s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-quobyte-39fdef0d-ae4d-4664-b3bb-c33741083bed" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-39fdef0d-ae4d-4664-b3bb-c33741083bed" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Deleting offline snapshot 39fdef0d-ae4d-4664-b3bb-c33741083bed of volume 9d131987-97f2-4a22-aae0-985c6e289d6f {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:44:10 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] snapshot_file for this snap is: volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-88e92512-4cbb-4daf-8ff6-5e4728680082" returned: 0 in 0.667s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "cinder-quobyte-88e92512-4cbb-4daf-8ff6-5e4728680082" released by "delete_volume" :: held 1.430s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9979d57-c68d-49a7-9886-9084dd5b1026]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:10 devstack cinder-volume[86649]: WARNING cinder.quota [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1906128943-539754879 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1906128943-539754879, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:44:10 devstack cinder-volume[86649]: WARNING cinder.quota [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1906128943-539754879 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1906128943-539754879, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:44:11 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Created reservations ['cc09f345-2677-42e6-873d-a485f31ecc7f', '815ea730-be5c-44a1-9b7b-0a2844d6b1d0', '99707b12-e386-4de4-a88b-4419044d478c', '71fe9bcb-383d-4b9c-995d-73a61185e625'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:44:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:11 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed Jun 01 09:44:11 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:11 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:44:11 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:11 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed" returned: 0 in 0.900s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d131987-97f2-4a22-aae0-985c6e289d6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:44:11 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.786s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:11 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:44:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Deleted volume successfully. Jun 01 09:44:11 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced4e8eb-2963-495c-b97a-a78eca524691]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee20dfce-d30e-43e4-b8f3-f92bd5c124a3 tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "cinder-88e92512-4cbb-4daf-8ff6-5e4728680082-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:11 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f Jun 01 09:44:11 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:12 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f" returned: 0 in 0.699s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:12 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed Jun 01 09:44:12 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:13 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed" returned: 0 in 0.823s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:13 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed Jun 01 09:44:13 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:14 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f.39fdef0d-ae4d-4664-b3bb-c33741083bed" returned: 0 in 0.629s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-39fdef0d-ae4d-4664-b3bb-c33741083bed" released by "_delete_snapshot" :: held 3.171s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.115s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca2500e-1541-4cee-a5fa-2f94deac3987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9215527b-3eb6-4722-a82d-3807a65b8c6d', 'volume_size': 1, 'source_volid': '9d131987-97f2-4a22-aae0-985c6e289d6f', 'source_volstatus': 'available'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce633bc-d50d-4f1d-b6e2-917cb30af40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:14 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Volume volume-9215527b-3eb6-4722-a82d-3807a65b8c6d (9215527b-3eb6-4722-a82d-3807a65b8c6d): created successfully Jun 01 09:44:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce633bc-d50d-4f1d-b6e2-917cb30af40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Flow 'volume_create_manager' (c8009cac-b300-4ec4-8cab-2e93a1d8a0b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-47ff1b33-9810-45dd-bd5e-25fe9eb19920 tempest-VolumesGetTest-642626030 None] Created volume successfully. Jun 01 09:44:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-e7b50a40-a0f3-44ed-b610-5a2b8c700571 req-915ffc34-74a7-43d4-97fa-9582cfa2f8a9 tempest-TestInstancesWithCinderVolumes-1636806809 None] Terminate volume connection completed successfully. Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e7b50a40-a0f3-44ed-b610-5a2b8c700571 req-915ffc34-74a7-43d4-97fa-9582cfa2f8a9 tempest-TestInstancesWithCinderVolumes-1636806809 None] Deleting attachment d07c720c-6023-41e0-8dbc-28dabfab2083. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Flow 'volume_create_manager' (87f0de65-591c-4c30-a641-d2c8f89bf5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4a41d2-7338-4b0e-a0fc-52c9b42f39dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4a41d2-7338-4b0e-a0fc-52c9b42f39dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-451981239',display_name='tempest-VolumesGetTest-Volume-296343583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cceac5-9cf5-44e6-9468-3f003d40131f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c0dd96306348b7b26f0c50a2993152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:16Z,use_quota=True,user_id='6537c6e3c00c4d2f9f92ae03cde8983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3ad0ee-f015-4508-a6e9-1c3c9f786aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3ad0ee-f015-4508-a6e9-1c3c9f786aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de88f4ac-738c-4b8e-b81c-9b3d37881e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de88f4ac-738c-4b8e-b81c-9b3d37881e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1cceac5-9cf5-44e6-9468-3f003d40131f', 'volume_name': 'volume-b1cceac5-9cf5-44e6-9468-3f003d40131f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42abe432-c691-419c-b2d0-56934fc0c871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42abe432-c691-419c-b2d0-56934fc0c871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d59c56-4376-4e77-b4a4-4e06152be085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:15 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Volume b1cceac5-9cf5-44e6-9468-3f003d40131f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1cceac5-9cf5-44e6-9468-3f003d40131f', 'volume_size': 1} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-451981239',display_name='tempest-VolumesGetTest-Volume-296343583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cceac5-9cf5-44e6-9468-3f003d40131f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c0dd96306348b7b26f0c50a2993152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:16Z,use_quota=True,user_id='6537c6e3c00c4d2f9f92ae03cde8983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Creating volume b1cceac5-9cf5-44e6-9468-3f003d40131f {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:44:15 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:44:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b1cceac5-9cf5-44e6-9468-3f003d40131f 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:15 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b1cceac5-9cf5-44e6-9468-3f003d40131f 1073741824 Jun 01 09:44:15 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:16 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b1cceac5-9cf5-44e6-9468-3f003d40131f 1073741824" returned: 0 in 0.746s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b1cceac5-9cf5-44e6-9468-3f003d40131f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:16 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b1cceac5-9cf5-44e6-9468-3f003d40131f Jun 01 09:44:16 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:17 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b1cceac5-9cf5-44e6-9468-3f003d40131f" returned: 0 in 0.584s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:44:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d59c56-4376-4e77-b4a4-4e06152be085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1cceac5-9cf5-44e6-9468-3f003d40131f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e7ba98-aa56-4cb4-8b7a-e62d32f6a956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:17 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Volume volume-b1cceac5-9cf5-44e6-9468-3f003d40131f (b1cceac5-9cf5-44e6-9468-3f003d40131f): created successfully Jun 01 09:44:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e7ba98-aa56-4cb4-8b7a-e62d32f6a956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Flow 'volume_create_manager' (87f0de65-591c-4c30-a641-d2c8f89bf5c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:17 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4af20ab5-b098-4360-8980-646dfb010958 tempest-VolumesGetTest-642626030 None] Created volume successfully. Jun 01 09:44:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-b1cceac5-9cf5-44e6-9468-3f003d40131f-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Lock "cinder-b1cceac5-9cf5-44e6-9468-3f003d40131f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-quobyte-b1cceac5-9cf5-44e6-9468-3f003d40131f" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-b1cceac5-9cf5-44e6-9468-3f003d40131f" acquired by "delete_volume" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edfd380-de6e-4788-afca-e0ccccaf1231]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b1cceac5-9cf5-44e6-9468-3f003d40131f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:18 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b1cceac5-9cf5-44e6-9468-3f003d40131f Jun 01 09:44:18 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:18 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b1cceac5-9cf5-44e6-9468-3f003d40131f" returned: 0 in 0.692s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b1cceac5-9cf5-44e6-9468-3f003d40131f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:18 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b1cceac5-9cf5-44e6-9468-3f003d40131f Jun 01 09:44:18 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "cinder-6ecac4f5-755b-4aba-b0b3-0a4f80558e41-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "cinder-6ecac4f5-755b-4aba-b0b3-0a4f80558e41-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "cinder-quobyte-6ecac4f5-755b-4aba-b0b3-0a4f80558e41" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "cinder-quobyte-6ecac4f5-755b-4aba-b0b3-0a4f80558e41" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70f7953-901d-40ad-84c1-bedb1e6e18e0]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:19 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 Jun 01 09:44:19 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:19 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-b1cceac5-9cf5-44e6-9468-3f003d40131f" returned: 0 in 0.602s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-b1cceac5-9cf5-44e6-9468-3f003d40131f" released by "delete_volume" :: held 1.332s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Created reservations ['6c90b0c9-da0e-494e-a966-8b569fedac44', '3dac50a9-f635-413a-8e5c-9e6b645b4097', '5a375c68-f09b-4c9e-87da-30e964dddf63', '25052573-9e14-4881-840d-7167bfa958b3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:19 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:44:19 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:19 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41" returned: 0 in 0.694s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:19 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 Jun 01 09:44:19 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:20 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.602s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:20 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:44:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Deleted volume successfully. Jun 01 09:44:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-48347039-9eed-4a80-a7c2-f14c39ee3649 tempest-VolumesGetTest-642626030 None] Lock "cinder-b1cceac5-9cf5-44e6-9468-3f003d40131f-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-9215527b-3eb6-4722-a82d-3807a65b8c6d-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Lock "cinder-9215527b-3eb6-4722-a82d-3807a65b8c6d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-quobyte-9215527b-3eb6-4722-a82d-3807a65b8c6d" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-9215527b-3eb6-4722-a82d-3807a65b8c6d" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:20 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[107e2c86-f9c5-4dba-b923-2d8a7e5f49bf]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:20 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d Jun 01 09:44:20 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:20 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41" returned: 1 in 0.696s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:44:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:20 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41 Jun 01 09:44:20 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:21 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d" returned: 0 in 0.699s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:21 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d Jun 01 09:44:21 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:21 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6ecac4f5-755b-4aba-b0b3-0a4f80558e41" returned: 0 in 0.613s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "cinder-quobyte-6ecac4f5-755b-4aba-b0b3-0a4f80558e41" released by "delete_volume" :: held 2.069s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:21 devstack cinder-volume[86649]: WARNING cinder.quota [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1382515403-227019448 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1382515403-227019448, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:44:21 devstack cinder-volume[86649]: WARNING cinder.quota [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1382515403-227019448 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1382515403-227019448, it is now deprecated. Please use the default quota class for default quota. Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Created reservations ['3c788d42-51cb-46b3-8c31-9de008d4676b', '5b595200-2664-439b-9b56-954263d44125', '90815062-f17e-41e2-a647-c5537ad1dbe8', 'b072f1bd-8b45-4d00-a9cb-ed986aca2879'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:21 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:44:21 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:21 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9215527b-3eb6-4722-a82d-3807a65b8c6d" returned: 0 in 0.601s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-9215527b-3eb6-4722-a82d-3807a65b8c6d" released by "delete_volume" :: held 1.345s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Created reservations ['1b33eaec-4093-423e-9ba8-65383d0c22b3', '3b590e03-bac6-4387-ae9e-7f57bf86a60e', '156e70a1-6b45-491f-9077-31b6fe9265dc', 'b08026d6-fa05-4e2e-a746-89112764f9f3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:21 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:44:21 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:21 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.597s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:44:21 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Deleted volume successfully. Jun 01 09:44:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d9f5ff40-c51f-4669-bf34-7da6839b1efb tempest-TestInstancesWithCinderVolumes-1636806809 None] Lock "cinder-6ecac4f5-755b-4aba-b0b3-0a4f80558e41-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:22 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.604s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:22 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:44:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Deleted volume successfully. Jun 01 09:44:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a69639aa-8967-4f09-8f50-2c8d370a9bb8 tempest-VolumesGetTest-642626030 None] Lock "cinder-9215527b-3eb6-4722-a82d-3807a65b8c6d-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-9d131987-97f2-4a22-aae0-985c6e289d6f-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Lock "cinder-9d131987-97f2-4a22-aae0-985c6e289d6f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-quobyte-9d131987-97f2-4a22-aae0-985c6e289d6f" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-9d131987-97f2-4a22-aae0-985c6e289d6f" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:22 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d670e42-48f1-4362-b4ce-8b0097b749df]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:22 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f Jun 01 09:44:22 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:23 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f" returned: 0 in 0.734s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:23 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f Jun 01 09:44:23 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:24 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9d131987-97f2-4a22-aae0-985c6e289d6f" returned: 0 in 0.606s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-9d131987-97f2-4a22-aae0-985c6e289d6f" released by "delete_volume" :: held 1.400s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:24 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Created reservations ['db722921-9d69-4ca2-a493-7fa83c3729fd', 'bec7bfc7-e9db-41b7-a07a-df7a2c382bd3', 'a82ce655-8ce5-488c-9bc8-2cd9346723d4', '832ced42-01dd-463a-8ae9-0655a6e8a2fb'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:44:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:24 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:44:24 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:24 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.645s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:24 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:44:24 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Deleted volume successfully. Jun 01 09:44:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-25f5a31a-ebb8-46a2-84fa-14ea44af55ba tempest-VolumesGetTest-642626030 None] Lock "cinder-9d131987-97f2-4a22-aae0-985c6e289d6f-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:25 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:44:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Flow 'volume_create_manager' (4e2866ac-7c71-4959-aec5-8e55fae9d49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82696e02-5497-47d4-84ba-ea633bf23d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82696e02-5497-47d4-84ba-ea633bf23d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1157776101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1eb44d8-aff9-4c29-b112-fd40e8f642e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2c0dd96306348b7b26f0c50a2993152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:26Z,use_quota=True,user_id='6537c6e3c00c4d2f9f92ae03cde8983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e468d2-d241-4086-a794-c55b03696b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e468d2-d241-4086-a794-c55b03696b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bb3c21-14b4-485c-aba0-25beb9db91e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:25 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 01 09:44:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bb3c21-14b4-485c-aba0-25beb9db91e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd1eb44d8-aff9-4c29-b112-fd40e8f642e5', 'volume_name': 'volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5', 'volume_size': 1, 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e7cfcad8294f4eb88f2de87e0a453e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'created_at': datetime.datetime(2026, 6, 1, 7, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba10981d-df4d-46cf-aa65-cb37ba60eef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba10981d-df4d-46cf-aa65-cb37ba60eef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe967bca-4c4d-49a2-8357-707b1a43d36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:26 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Volume d1eb44d8-aff9-4c29-b112-fd40e8f642e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5', 'volume_size': 1, 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e7cfcad8294f4eb88f2de87e0a453e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'created_at': datetime.datetime(2026, 6, 1, 7, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 01 09:44:26 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Trying to clone d1eb44d8-aff9-4c29-b112-fd40e8f642e5 from image c04f6c24-cff4-40fb-8629-0b2dcb859f85 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 01 09:44:26 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__5mfvqs7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 01 09:44:26 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Image download 20.69 MB at 20.69 MB/s Jun 01 09:44:26 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[723641a7-a00d-44c4-bb9b-609d33001412]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__5mfvqs7devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:26 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__5mfvqs7devstack@QuobyteHD Jun 01 09:44:26 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:27 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__5mfvqs7devstack@QuobyteHD" returned: 0 in 0.729s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:27 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Temporary image c04f6c24-cff4-40fb-8629-0b2dcb859f85 is fetched for user 6537c6e3c00c4d2f9f92ae03cde8983c. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 01 09:44:27 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=93,cinder:UPDATE=115,cinder:INSERT=22,cinder:DELETE=8 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:44:27 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=92,cinder:UPDATE=116,cinder:INSERT=31,cinder:DELETE=9 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:44:27 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[249dab9c-2d89-4f87-8296-55d5227249f8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__5mfvqs7devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:27 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__5mfvqs7devstack@QuobyteHD Jun 01 09:44:27 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:28 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__5mfvqs7devstack@QuobyteHD" returned: 0 in 0.727s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1157776101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1eb44d8-aff9-4c29-b112-fd40e8f642e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2c0dd96306348b7b26f0c50a2993152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:26Z,use_quota=True,user_id='6537c6e3c00c4d2f9f92ae03cde8983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:44:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Creating volume d1eb44d8-aff9-4c29-b112-fd40e8f642e5 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:44:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:44:28 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:44:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:28 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 1073741824 Jun 01 09:44:28 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:29 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 1073741824" returned: 0 in 0.775s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:29 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 Jun 01 09:44:29 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:29 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5" returned: 0 in 0.635s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:44:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:29 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Attempting download of c04f6c24-cff4-40fb-8629-0b2dcb859f85 ((None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}])) to volume d1eb44d8-aff9-4c29-b112-fd40e8f642e5. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 01 09:44:29 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e784a95-11b0-4d50-a5b0-56d8dc37765c]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_n16evdiy {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:29 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_n16evdiy Jun 01 09:44:29 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:30 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_n16evdiy" returned: 0 in 0.714s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_n16evdiy {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:30 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_n16evdiy Jun 01 09:44:30 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:31 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_n16evdiy" returned: 1 in 0.710s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c04f6c24-cff4-40fb-8629-0b2dcb859f85_n16evdiy' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:44:31 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[054f97ce-9ddd-4b9f-a992-72a91e169d10]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__5mfvqs7devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:31 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__5mfvqs7devstack@QuobyteHD Jun 01 09:44:31 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:31 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__5mfvqs7devstack@QuobyteHD" returned: 0 in 0.686s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:31 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] c04f6c24-cff4-40fb-8629-0b2dcb859f85 was qcow2, converting to raw {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 01 09:44:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__5mfvqs7devstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:31 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__5mfvqs7devstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 Jun 01 09:44:31 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:33 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__5mfvqs7devstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5" returned: 0 in 2.012s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:33 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c04f6c24-cff4-40fb-8629-0b2dcb859f85__5mfvqs7devstack@QuobyteHD, size 112.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:44:33 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Converted 112.00 MB image at 55.64 MB/s Jun 01 09:44:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:33 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 1G Jun 01 09:44:33 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:34 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 1G" returned: 0 in 0.645s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd75e63-efa8-459f-b28c-c56f37001ed6]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:34 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 Jun 01 09:44:34 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:35 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5" returned: 0 in 0.687s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:35 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 Jun 01 09:44:35 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:36 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5" returned: 1 in 0.689s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Downloaded image c04f6c24-cff4-40fb-8629-0b2dcb859f85 ((None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}])) to volume d1eb44d8-aff9-4c29-b112-fd40e8f642e5 successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Temporary image c04f6c24-cff4-40fb-8629-0b2dcb859f85 for user 6537c6e3c00c4d2f9f92ae03cde8983c is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Marking volume d1eb44d8-aff9-4c29-b112-fd40e8f642e5 as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Copying metadata from image c04f6c24-cff4-40fb-8629-0b2dcb859f85 to d1eb44d8-aff9-4c29-b112-fd40e8f642e5. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Creating volume glance metadata for volume d1eb44d8-aff9-4c29-b112-fd40e8f642e5 backed by image c04f6c24-cff4-40fb-8629-0b2dcb859f85 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe967bca-4c4d-49a2-8357-707b1a43d36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5', 'volume_size': 1, 'image_id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e7cfcad8294f4eb88f2de87e0a453e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c04f6c24-cff4-40fb-8629-0b2dcb859f85', 'created_at': datetime.datetime(2026, 6, 1, 7, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c04f6c24-cff4-40fb-8629-0b2dcb859f85/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7ce613-4597-49a7-9a07-d4fb35c12385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Volume volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 (d1eb44d8-aff9-4c29-b112-fd40e8f642e5): created successfully Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7ce613-4597-49a7-9a07-d4fb35c12385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Flow 'volume_create_manager' (4e2866ac-7c71-4959-aec5-8e55fae9d49c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4cb3aa10-bd76-43a6-b1e7-01e214c0f194 tempest-VolumesGetTest-642626030 None] Created volume successfully. Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:36 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:44:36 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Flow 'volume_create_manager' (821a4213-35d6-4bef-9310-01007efb361d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba53ac8a-0e97-49ce-8388-494212ea5e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba53ac8a-0e97-49ce-8388-494212ea5e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1759875839',display_name='tempest-VolumesGetTest-Volume-1727727190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c7191d-f753-45a5-9a40-42e1cdb2ac0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c0dd96306348b7b26f0c50a2993152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:37Z,use_quota=True,user_id='6537c6e3c00c4d2f9f92ae03cde8983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44764767-7a64-4d48-92b9-d406cd212553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44764767-7a64-4d48-92b9-d406cd212553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0effd3-1a12-40f0-8090-87014ac8595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0effd3-1a12-40f0-8090-87014ac8595d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c7191d-f753-45a5-9a40-42e1cdb2ac0a', 'volume_name': 'volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8ff527-42a4-421c-ad44-d4c6cee6ed79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8ff527-42a4-421c-ad44-d4c6cee6ed79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3079f3-d553-415e-ac62-c87384fd654f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Volume 42c7191d-f753-45a5-9a40-42e1cdb2ac0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a', 'volume_size': 1} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1759875839',display_name='tempest-VolumesGetTest-Volume-1727727190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c7191d-f753-45a5-9a40-42e1cdb2ac0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c0dd96306348b7b26f0c50a2993152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:37Z,use_quota=True,user_id='6537c6e3c00c4d2f9f92ae03cde8983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Creating volume 42c7191d-f753-45a5-9a40-42e1cdb2ac0a {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:44:37 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:44:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:37 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a 1073741824 Jun 01 09:44:37 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:37 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.649s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:44:37 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a 1073741824" returned: 0 in 0.928s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:38 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a Jun 01 09:44:38 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:38 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a" returned: 0 in 0.615s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:44:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3079f3-d553-415e-ac62-c87384fd654f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61930c5b-d9b6-40f9-b876-7f2d01210e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:38 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Volume volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a (42c7191d-f753-45a5-9a40-42e1cdb2ac0a): created successfully Jun 01 09:44:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61930c5b-d9b6-40f9-b876-7f2d01210e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Flow 'volume_create_manager' (821a4213-35d6-4bef-9310-01007efb361d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:38 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ae2730d8-fef2-4dde-beea-be0bef04db4f tempest-VolumesGetTest-642626030 None] Created volume successfully. Jun 01 09:44:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-42c7191d-f753-45a5-9a40-42e1cdb2ac0a-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Lock "cinder-42c7191d-f753-45a5-9a40-42e1cdb2ac0a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-quobyte-42c7191d-f753-45a5-9a40-42e1cdb2ac0a" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-42c7191d-f753-45a5-9a40-42e1cdb2ac0a" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7793e110-abfe-4770-a79c-490d581a23a4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:39 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a Jun 01 09:44:39 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:40 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a" returned: 0 in 0.763s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:40 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a Jun 01 09:44:40 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:40 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-42c7191d-f753-45a5-9a40-42e1cdb2ac0a" returned: 0 in 0.747s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-42c7191d-f753-45a5-9a40-42e1cdb2ac0a" released by "delete_volume" :: held 1.556s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:40 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Created reservations ['8ad24a5e-7479-441b-bc82-916133ab7c38', '50f47679-55e4-4168-943d-23ba1fc70fc3', 'bce90a23-c012-4085-acfa-7e34d1cfbfc1', '3b27e224-f067-4ceb-8b90-68c10e8c59ae'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:44:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:40 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:44:40 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-d1eb44d8-aff9-4c29-b112-fd40e8f642e5-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Lock "cinder-d1eb44d8-aff9-4c29-b112-fd40e8f642e5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:41 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.633s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:41 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:44:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Acquiring lock "cinder-quobyte-d1eb44d8-aff9-4c29-b112-fd40e8f642e5" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Deleted volume successfully. Jun 01 09:44:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-d1eb44d8-aff9-4c29-b112-fd40e8f642e5" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9004f4e3-7c82-4db5-a1db-eb36e32b67fe tempest-VolumesGetTest-642626030 None] Lock "cinder-42c7191d-f753-45a5-9a40-42e1cdb2ac0a-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[58804ddd-b7f5-4068-8004-bfc4cdad6aaf]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:41 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 Jun 01 09:44:41 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:42 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5" returned: 0 in 0.729s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:42 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 Jun 01 09:44:42 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:43 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5" returned: 1 in 0.741s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:44:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:43 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5 Jun 01 09:44:43 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:43 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d1eb44d8-aff9-4c29-b112-fd40e8f642e5" returned: 0 in 0.593s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Lock "cinder-quobyte-d1eb44d8-aff9-4c29-b112-fd40e8f642e5" released by "delete_volume" :: held 2.132s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:43 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Created reservations ['35736800-b6ff-4fb2-8a3f-bd507946c447', '7a5c4c28-29bf-4619-88b2-6661f6af1ed4', 'cd7a17e9-949b-4e33-8784-a1405e7f6d74', 'f3aba2c2-ff10-486b-bb46-21d8d247feca'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:44:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:43 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:44:43 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:44 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.612s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:44 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:44:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Deleted volume successfully. Jun 01 09:44:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b6d3a07c-5a1b-49e7-bfea-2fc637bc23ca tempest-VolumesGetTest-642626030 None] Lock "cinder-d1eb44d8-aff9-4c29-b112-fd40e8f642e5-delete_volume" released by "delete_volume" :: held 2.958s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Flow 'volume_create_manager' (008e591c-4db9-4d7b-8abd-3e798e30cc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dd1974-e8d7-46e2-8396-5f1bb5d9b6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dd1974-e8d7-46e2-8396-5f1bb5d9b6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-887749188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d3a55f-308d-4f56-8ef7-72d63eef92da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1d7cf7b7af04491afa0b5edec5d4574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:48Z,use_quota=True,user_id='c25db63256a94c65b07e9dc1c4aa7bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c538ed-54d3-477d-95f4-ae8f90235d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c538ed-54d3-477d-95f4-ae8f90235d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a15e70-961d-4c4a-b7a7-25aaba0bb3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a15e70-961d-4c4a-b7a7-25aaba0bb3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89d3a55f-308d-4f56-8ef7-72d63eef92da', 'volume_name': 'volume-89d3a55f-308d-4f56-8ef7-72d63eef92da', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de277653-f84f-4ba8-93ae-d5e3621dbafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de277653-f84f-4ba8-93ae-d5e3621dbafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88cdad8a-c7e6-4c16-8bdb-4ad08e548e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:47 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Volume 89d3a55f-308d-4f56-8ef7-72d63eef92da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89d3a55f-308d-4f56-8ef7-72d63eef92da', 'volume_size': 1} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-887749188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d3a55f-308d-4f56-8ef7-72d63eef92da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1d7cf7b7af04491afa0b5edec5d4574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:48Z,use_quota=True,user_id='c25db63256a94c65b07e9dc1c4aa7bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Creating volume 89d3a55f-308d-4f56-8ef7-72d63eef92da {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:44:47 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:44:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-89d3a55f-308d-4f56-8ef7-72d63eef92da 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:48 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-89d3a55f-308d-4f56-8ef7-72d63eef92da 1073741824 Jun 01 09:44:48 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:48 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-89d3a55f-308d-4f56-8ef7-72d63eef92da 1073741824" returned: 0 in 0.829s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-89d3a55f-308d-4f56-8ef7-72d63eef92da {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:48 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-89d3a55f-308d-4f56-8ef7-72d63eef92da Jun 01 09:44:48 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:49 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-89d3a55f-308d-4f56-8ef7-72d63eef92da" returned: 0 in 0.598s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:44:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88cdad8a-c7e6-4c16-8bdb-4ad08e548e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89d3a55f-308d-4f56-8ef7-72d63eef92da', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4ed8d8-ced6-4a47-8895-3e80d9fea79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:49 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Volume volume-89d3a55f-308d-4f56-8ef7-72d63eef92da (89d3a55f-308d-4f56-8ef7-72d63eef92da): created successfully Jun 01 09:44:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4ed8d8-ced6-4a47-8895-3e80d9fea79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Flow 'volume_create_manager' (008e591c-4db9-4d7b-8abd-3e798e30cc45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-17cae36d-c844-4592-9a1f-df2003f4ff3c tempest-VolumesListTestJSON-1300149366 None] Created volume successfully. Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Flow 'volume_create_manager' (3f3fc9e0-8f02-4b80-a0f5-b276b6bc141f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d774c35-d4eb-4450-9e5c-188da1b52c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d774c35-d4eb-4450-9e5c-188da1b52c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1886183220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe6678f-bf7b-41fe-8828-37958e87ba83,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1d7cf7b7af04491afa0b5edec5d4574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:50Z,use_quota=True,user_id='c25db63256a94c65b07e9dc1c4aa7bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6e14c3-3e54-490d-a21f-9452be33a918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6e14c3-3e54-490d-a21f-9452be33a918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4b5b16-3430-4b1f-9b7b-5c564e847e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4b5b16-3430-4b1f-9b7b-5c564e847e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe6678f-bf7b-41fe-8828-37958e87ba83', 'volume_name': 'volume-9fe6678f-bf7b-41fe-8828-37958e87ba83', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78703021-b197-4611-ad53-ac3623df1d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78703021-b197-4611-ad53-ac3623df1d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5897e2fd-5ed3-4857-9d66-5e1a5d922558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:50 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Volume 9fe6678f-bf7b-41fe-8828-37958e87ba83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe6678f-bf7b-41fe-8828-37958e87ba83', 'volume_size': 1} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1886183220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe6678f-bf7b-41fe-8828-37958e87ba83,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1d7cf7b7af04491afa0b5edec5d4574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:50Z,use_quota=True,user_id='c25db63256a94c65b07e9dc1c4aa7bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Creating volume 9fe6678f-bf7b-41fe-8828-37958e87ba83 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:44:50 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:44:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fe6678f-bf7b-41fe-8828-37958e87ba83 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:50 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fe6678f-bf7b-41fe-8828-37958e87ba83 1073741824 Jun 01 09:44:50 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:51 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fe6678f-bf7b-41fe-8828-37958e87ba83 1073741824" returned: 0 in 0.874s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fe6678f-bf7b-41fe-8828-37958e87ba83 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:51 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fe6678f-bf7b-41fe-8828-37958e87ba83 Jun 01 09:44:51 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:52 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fe6678f-bf7b-41fe-8828-37958e87ba83" returned: 0 in 0.606s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5897e2fd-5ed3-4857-9d66-5e1a5d922558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe6678f-bf7b-41fe-8828-37958e87ba83', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfcbc9d-32ea-4cd5-a1fa-d390b1bdeff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:52 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Volume volume-9fe6678f-bf7b-41fe-8828-37958e87ba83 (9fe6678f-bf7b-41fe-8828-37958e87ba83): created successfully Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfcbc9d-32ea-4cd5-a1fa-d390b1bdeff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Flow 'volume_create_manager' (3f3fc9e0-8f02-4b80-a0f5-b276b6bc141f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b209fcf2-67cd-4817-b46d-72ab16f705b9 tempest-VolumesListTestJSON-1300149366 None] Created volume successfully. Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Flow 'volume_create_manager' (63947048-82c9-4856-8422-9699875eaa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e537b80c-5679-477f-b260-c31b3358541c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e537b80c-5679-477f-b260-c31b3358541c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-345663239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bc481b-0154-4110-aee4-7368f7f97a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b124f3760e9245059053f5b73aba996a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:52Z,use_quota=True,user_id='74490ccad6d749a791ef4419324df534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd096a3-0207-4cbb-9f29-a791059caa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd096a3-0207-4cbb-9f29-a791059caa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40534de2-f643-497e-b685-077bf8592236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40534de2-f643-497e-b685-077bf8592236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80bc481b-0154-4110-aee4-7368f7f97a62', 'volume_name': 'volume-80bc481b-0154-4110-aee4-7368f7f97a62', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1309b759-7680-46f9-a137-5f3969f97ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1309b759-7680-46f9-a137-5f3969f97ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb058c22-c4e1-4bd0-9fee-531f1bee5715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:52 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Volume 80bc481b-0154-4110-aee4-7368f7f97a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80bc481b-0154-4110-aee4-7368f7f97a62', 'volume_size': 1} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-345663239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bc481b-0154-4110-aee4-7368f7f97a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b124f3760e9245059053f5b73aba996a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:52Z,use_quota=True,user_id='74490ccad6d749a791ef4419324df534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Creating volume 80bc481b-0154-4110-aee4-7368f7f97a62 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:44:52 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:52 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62 1073741824 Jun 01 09:44:52 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Flow 'volume_create_manager' (2a7b5b28-147f-4258-b66b-1d2ee1e4885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ffd980-a690-426f-a7d5-e7a06c6b6a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ffd980-a690-426f-a7d5-e7a06c6b6a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2017584588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1334d9b3-0de7-4ff4-ab9d-9673fb49583d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b124f3760e9245059053f5b73aba996a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:53Z,use_quota=True,user_id='74490ccad6d749a791ef4419324df534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8d8582-84d1-47a7-b2d3-d70ca9c03c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8d8582-84d1-47a7-b2d3-d70ca9c03c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0940dd-7347-471c-83f3-4844280ac84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0940dd-7347-471c-83f3-4844280ac84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1334d9b3-0de7-4ff4-ab9d-9673fb49583d', 'volume_name': 'volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6545c9-b8ff-435c-825a-d5bb7d509c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6545c9-b8ff-435c-825a-d5bb7d509c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bacdc94-8205-4008-83ab-3e69e462f2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:52 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Volume 1334d9b3-0de7-4ff4-ab9d-9673fb49583d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d', 'volume_size': 1} Jun 01 09:44:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Flow 'volume_create_manager' (de4f5552-00cd-4e8e-aeb6-a290dc562a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b68087-4d40-4053-ab53-b955c36b97fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b68087-4d40-4053-ab53-b955c36b97fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1958301449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b4576c-4991-4fe4-80ba-48afe423b704,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1d7cf7b7af04491afa0b5edec5d4574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:53Z,use_quota=True,user_id='c25db63256a94c65b07e9dc1c4aa7bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5312f129-b1ac-451c-bf6c-f0e93d82c339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5312f129-b1ac-451c-bf6c-f0e93d82c339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb71f82-c221-4323-a992-9d2f5a6ca4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb71f82-c221-4323-a992-9d2f5a6ca4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b4576c-4991-4fe4-80ba-48afe423b704', 'volume_name': 'volume-24b4576c-4991-4fe4-80ba-48afe423b704', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c91603-bef9-4528-8d02-b0d0b10cc913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c91603-bef9-4528-8d02-b0d0b10cc913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25256165-cbf3-4e24-8cbb-a1b46804d91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:53 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Volume 24b4576c-4991-4fe4-80ba-48afe423b704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b4576c-4991-4fe4-80ba-48afe423b704', 'volume_size': 1} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:53 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62 1073741824" returned: 0 in 0.929s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:53 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62 Jun 01 09:44:53 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:53 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62" returned: 0 in 0.600s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.159s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2017584588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1334d9b3-0de7-4ff4-ab9d-9673fb49583d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b124f3760e9245059053f5b73aba996a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:53Z,use_quota=True,user_id='74490ccad6d749a791ef4419324df534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Creating volume 1334d9b3-0de7-4ff4-ab9d-9673fb49583d {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:44:53 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:53 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d 1073741824 Jun 01 09:44:53 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb058c22-c4e1-4bd0-9fee-531f1bee5715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80bc481b-0154-4110-aee4-7368f7f97a62', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4d2ded-16ad-4558-8994-09478c400a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:54 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Volume volume-80bc481b-0154-4110-aee4-7368f7f97a62 (80bc481b-0154-4110-aee4-7368f7f97a62): created successfully Jun 01 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4d2ded-16ad-4558-8994-09478c400a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Flow 'volume_create_manager' (63947048-82c9-4856-8422-9699875eaa73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f34f3872-15d4-40ff-8ea0-e912d309a139 tempest-TestServerVolumeAttachmentScenario-933852407 None] Created volume successfully. Jun 01 09:44:54 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d 1073741824" returned: 0 in 0.840s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:54 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d Jun 01 09:44:54 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:55 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d" returned: 0 in 0.628s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.172s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1958301449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b4576c-4991-4fe4-80ba-48afe423b704,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1d7cf7b7af04491afa0b5edec5d4574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:44:53Z,use_quota=True,user_id='c25db63256a94c65b07e9dc1c4aa7bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Creating volume 24b4576c-4991-4fe4-80ba-48afe423b704 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:44:55 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-24b4576c-4991-4fe4-80ba-48afe423b704 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bacdc94-8205-4008-83ab-3e69e462f2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392bf8c4-7436-46de-a2c3-62234d4397ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:55 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-24b4576c-4991-4fe4-80ba-48afe423b704 1073741824 Jun 01 09:44:55 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:55 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Volume volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d (1334d9b3-0de7-4ff4-ab9d-9673fb49583d): created successfully Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392bf8c4-7436-46de-a2c3-62234d4397ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Flow 'volume_create_manager' (2a7b5b28-147f-4258-b66b-1d2ee1e4885f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-06e7de1b-1cb6-4665-a2c1-d05fcbbb9f44 tempest-TestServerVolumeAttachmentScenario-933852407 None] Created volume successfully. Jun 01 09:44:56 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-24b4576c-4991-4fe4-80ba-48afe423b704 1073741824" returned: 0 in 0.835s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-24b4576c-4991-4fe4-80ba-48afe423b704 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:56 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-24b4576c-4991-4fe4-80ba-48afe423b704 Jun 01 09:44:56 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:56 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-24b4576c-4991-4fe4-80ba-48afe423b704" returned: 0 in 0.617s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:44:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:44:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25256165-cbf3-4e24-8cbb-a1b46804d91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b4576c-4991-4fe4-80ba-48afe423b704', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3073be8e-5df1-49fa-ab8b-e9e23dcdfb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:44:56 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Volume volume-24b4576c-4991-4fe4-80ba-48afe423b704 (24b4576c-4991-4fe4-80ba-48afe423b704): created successfully Jun 01 09:44:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3073be8e-5df1-49fa-ab8b-e9e23dcdfb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:44:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Flow 'volume_create_manager' (de4f5552-00cd-4e8e-aeb6-a290dc562a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:44:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f0c136b3-a8dc-44d0-ae16-ed30427f80f3 tempest-VolumesListTestJSON-1300149366 None] Created volume successfully. Jun 01 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "cinder-24b4576c-4991-4fe4-80ba-48afe423b704-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Lock "cinder-24b4576c-4991-4fe4-80ba-48afe423b704-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "cinder-quobyte-24b4576c-4991-4fe4-80ba-48afe423b704" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Lock "cinder-quobyte-24b4576c-4991-4fe4-80ba-48afe423b704" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:44:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63a38f1-3863-4d7b-a44a-43acf64ade24]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-24b4576c-4991-4fe4-80ba-48afe423b704 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:44:59 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-24b4576c-4991-4fe4-80ba-48afe423b704 Jun 01 09:44:59 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:44:59 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jun 01 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-24b4576c-4991-4fe4-80ba-48afe423b704" returned: 0 in 0.730s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-24b4576c-4991-4fe4-80ba-48afe423b704 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:00 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-24b4576c-4991-4fe4-80ba-48afe423b704 Jun 01 09:45:00 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:00 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-24b4576c-4991-4fe4-80ba-48afe423b704" returned: 0 in 0.606s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Lock "cinder-quobyte-24b4576c-4991-4fe4-80ba-48afe423b704" released by "delete_volume" :: held 1.382s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Created reservations ['b5bc457a-0b47-4f78-bf1b-37d55a9c1473', 'ebbdce3a-b76d-4322-9903-fb892f2692d6', '0303d217-02b5-43b0-b54f-9dad0c36fab7', 'f6a12fbc-fae1-4cb8-b7b9-7fc227dff4e3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:00 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:45:00 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:01 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.650s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:45:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Deleted volume successfully. Jun 01 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c5b0f45-638d-4f79-9ade-51fa5b6f4a40 tempest-VolumesListTestJSON-1300149366 None] Lock "cinder-24b4576c-4991-4fe4-80ba-48afe423b704-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "cinder-9fe6678f-bf7b-41fe-8828-37958e87ba83-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Lock "cinder-9fe6678f-bf7b-41fe-8828-37958e87ba83-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "cinder-quobyte-9fe6678f-bf7b-41fe-8828-37958e87ba83" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Lock "cinder-quobyte-9fe6678f-bf7b-41fe-8828-37958e87ba83" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:01 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8b74c0-b44b-4bd5-8c53-105a54894751]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fe6678f-bf7b-41fe-8828-37958e87ba83 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:01 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fe6678f-bf7b-41fe-8828-37958e87ba83 Jun 01 09:45:01 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:02 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fe6678f-bf7b-41fe-8828-37958e87ba83" returned: 0 in 0.731s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fe6678f-bf7b-41fe-8828-37958e87ba83 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:02 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fe6678f-bf7b-41fe-8828-37958e87ba83 Jun 01 09:45:02 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:02 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9fe6678f-bf7b-41fe-8828-37958e87ba83" returned: 0 in 0.599s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Lock "cinder-quobyte-9fe6678f-bf7b-41fe-8828-37958e87ba83" released by "delete_volume" :: held 1.367s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:02 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Created reservations ['c19c837e-b8e1-4010-a5ea-30d71292ba6f', 'bc1375d0-feb1-478a-b8e5-b144f19c585d', '9e116b87-2f98-400e-9f5a-d23a85055c03', '3663d265-66fc-4e9f-86ed-945f67b4150c'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:03 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:45:03 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:03 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.604s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:45:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Deleted volume successfully. Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9e29a089-55f2-4f60-a9d5-797479b24252 tempest-VolumesListTestJSON-1300149366 None] Lock "cinder-9fe6678f-bf7b-41fe-8828-37958e87ba83-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "cinder-89d3a55f-308d-4f56-8ef7-72d63eef92da-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Lock "cinder-89d3a55f-308d-4f56-8ef7-72d63eef92da-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "cinder-quobyte-89d3a55f-308d-4f56-8ef7-72d63eef92da" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Lock "cinder-quobyte-89d3a55f-308d-4f56-8ef7-72d63eef92da" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[80812f53-bef3-4b4a-aa29-b6d86fb42cb3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-89d3a55f-308d-4f56-8ef7-72d63eef92da {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:04 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-89d3a55f-308d-4f56-8ef7-72d63eef92da Jun 01 09:45:04 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:04 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-89d3a55f-308d-4f56-8ef7-72d63eef92da" returned: 0 in 0.701s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-89d3a55f-308d-4f56-8ef7-72d63eef92da {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:04 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-89d3a55f-308d-4f56-8ef7-72d63eef92da Jun 01 09:45:04 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:05 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-89d3a55f-308d-4f56-8ef7-72d63eef92da" returned: 0 in 0.613s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Lock "cinder-quobyte-89d3a55f-308d-4f56-8ef7-72d63eef92da" released by "delete_volume" :: held 1.355s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:05 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Created reservations ['dc7c37d0-c0cb-4b63-9308-2d0f14d7ed92', 'b66e5739-210b-42a0-a193-83a6cd1e673f', '65792a1a-dd91-4108-a57c-6b5a9850ecef', 'c8d951c6-2d5e-4c92-9c71-1291cdf8df9c'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:45:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:45:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:45:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:05 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:45:05 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:05 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.578s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:05 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:45:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Deleted volume successfully. Jun 01 09:45:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee1ae4ac-91f4-4468-bcab-483a16811c06 tempest-VolumesListTestJSON-1300149366 None] Lock "cinder-89d3a55f-308d-4f56-8ef7-72d63eef92da-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:15 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=72,cinder:INSERT=16,cinder:SELECT=47,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:45:15 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:INSERT=24,cinder:SELECT=42,cinder:UPDATE=52,cinder:DELETE=8 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Flow 'volume_create_manager' (90c2d806-99de-4a88-b0bc-f604af23b15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86caf8b-f03a-4a20-88dd-e7e117a8802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86caf8b-f03a-4a20-88dd-e7e117a8802e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1060161960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46ce4ef-15b0-41d3-b698-aa7300ddafb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1316b7cf94d4b059f060945271530ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:45:21Z,use_quota=True,user_id='a216c8c048ad41e6925450f2ec3644f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8dff49-b0e2-40de-bb9d-eb817ff093ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8dff49-b0e2-40de-bb9d-eb817ff093ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f2e790-d077-489e-8654-b39874a1eb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f2e790-d077-489e-8654-b39874a1eb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46ce4ef-15b0-41d3-b698-aa7300ddafb8', 'volume_name': 'volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a24b3b9-7d32-4491-9ef4-035b767edea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a24b3b9-7d32-4491-9ef4-035b767edea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061c70a5-7bcb-4bc5-a9f6-a9c8f2ea6810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:20 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Volume a46ce4ef-15b0-41d3-b698-aa7300ddafb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8', 'volume_size': 1} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1060161960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46ce4ef-15b0-41d3-b698-aa7300ddafb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1316b7cf94d4b059f060945271530ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:45:21Z,use_quota=True,user_id='a216c8c048ad41e6925450f2ec3644f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Creating volume a46ce4ef-15b0-41d3-b698-aa7300ddafb8 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:45:20 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:45:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:20 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 1073741824 Jun 01 09:45:20 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:21 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 1073741824" returned: 0 in 0.749s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:21 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 Jun 01 09:45:21 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:22 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8" returned: 0 in 0.589s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:45:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061c70a5-7bcb-4bc5-a9f6-a9c8f2ea6810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48967947-4718-4b34-9050-105a1b3b533d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:22 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Volume volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 (a46ce4ef-15b0-41d3-b698-aa7300ddafb8): created successfully Jun 01 09:45:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48967947-4718-4b34-9050-105a1b3b533d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Flow 'volume_create_manager' (90c2d806-99de-4a88-b0bc-f604af23b15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:45:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d61256c5-63e1-4cac-813e-0629bd7cee97 tempest-VolumesSnapshotTestJSON-1920383358 None] Created volume successfully. Jun 01 09:45:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] Creating offline snapshot 83eb4a7b-7baf-4856-bc24-f4e22ce30277 of volume a46ce4ef-15b0-41d3-b698-aa7300ddafb8 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:45:23 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[07021d17-f932-4dd7-94da-76bfe6e09b82]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:23 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 Jun 01 09:45:23 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:23 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8" returned: 0 in 0.701s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:23 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 1G Jun 01 09:45:23 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:24 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 1G" returned: 0 in 0.719s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:24 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 Jun 01 09:45:24 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:25 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277" returned: 0 in 0.634s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:25 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 is being set with open permissions: ugo+rw Jun 01 09:45:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:25 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 Jun 01 09:45:25 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:25 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277" returned: 0 in 0.602s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:25 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.info Jun 01 09:45:25 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:26 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.info" returned: 0 in 0.601s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:26 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.info is being set with open permissions: ugo+rw Jun 01 09:45:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:26 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.info Jun 01 09:45:26 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:26 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.info" returned: 0 in 0.582s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.930s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:27 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c6a5dedd-62b1-441b-896d-7da9ac4c3519 tempest-VolumesSnapshotTestJSON-1920383358 None] Create snapshot completed successfully Jun 01 09:45:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-83eb4a7b-7baf-4856-bc24-f4e22ce30277-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-83eb4a7b-7baf-4856-bc24-f4e22ce30277-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-a46ce4ef-15b0-41d3-b698-aa7300ddafb8" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-a46ce4ef-15b0-41d3-b698-aa7300ddafb8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-83eb4a7b-7baf-4856-bc24-f4e22ce30277" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-83eb4a7b-7baf-4856-bc24-f4e22ce30277" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Deleting offline snapshot 83eb4a7b-7baf-4856-bc24-f4e22ce30277 of volume a46ce4ef-15b0-41d3-b698-aa7300ddafb8 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:45:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] snapshot_file for this snap is: volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:45:27 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7caa63b-d92d-4dd8-b841-b829a91dd7a4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:27 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 Jun 01 09:45:27 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:28 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277" returned: 0 in 0.714s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:45:28 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d535d073-d72b-4048-95a5-21b070e0d646]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:28 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 Jun 01 09:45:28 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:28 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8" returned: 0 in 0.725s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:28 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 Jun 01 09:45:28 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:29 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277" returned: 0 in 0.706s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:29 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277 Jun 01 09:45:29 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:30 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8.83eb4a7b-7baf-4856-bc24-f4e22ce30277" returned: 0 in 0.596s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-83eb4a7b-7baf-4856-bc24-f4e22ce30277" released by "_delete_snapshot" :: held 2.842s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-a46ce4ef-15b0-41d3-b698-aa7300ddafb8" released by "delete_snapshot" :: held 2.863s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:30 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Created reservations ['2b050e7b-7a37-4fff-bc5a-c447ecfcdd16', 'c9a9cfcd-b1ba-4a94-b7d8-e6dd9d228213', '13c1d9f0-6e11-451a-b9a4-99c8aa546cca', '05963c13-b8ee-41e7-abd8-37f9856bf304'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:45:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Delete snapshot completed successfully. Jun 01 09:45:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2fe102b-af55-4df8-9944-2025c5d3f065 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-83eb4a7b-7baf-4856-bc24-f4e22ce30277-delete_snapshot" released by "delete_snapshot" :: held 3.036s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:30 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:45:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Flow 'volume_create_manager' (7d3a372b-c64f-413a-9a03-e6d467aeb47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:45:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715038d7-d59f-4044-8b4a-6ca65e47d2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715038d7-d59f-4044-8b4a-6ca65e47d2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1451734457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1079b41b-1581-4f5f-a8e1-60ac52969e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1316b7cf94d4b059f060945271530ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:45:31Z,use_quota=True,user_id='a216c8c048ad41e6925450f2ec3644f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a1ff282-8cf8-4572-8967-fbcc22e23442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a1ff282-8cf8-4572-8967-fbcc22e23442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f11495-21e4-4805-963b-cd6490f3e938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f11495-21e4-4805-963b-cd6490f3e938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1079b41b-1581-4f5f-a8e1-60ac52969e0e', 'volume_name': 'volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84c8f82-de39-4c90-b511-6e46f313688e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84c8f82-de39-4c90-b511-6e46f313688e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4eb129-723b-4875-b4b2-90fc734324d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:31 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Volume 1079b41b-1581-4f5f-a8e1-60ac52969e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e', 'volume_size': 1} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1451734457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1079b41b-1581-4f5f-a8e1-60ac52969e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1316b7cf94d4b059f060945271530ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:45:31Z,use_quota=True,user_id='a216c8c048ad41e6925450f2ec3644f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Creating volume 1079b41b-1581-4f5f-a8e1-60ac52969e0e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:45:31 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:31 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e 1073741824 Jun 01 09:45:31 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:31 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e 1073741824" returned: 0 in 0.754s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:31 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e Jun 01 09:45:31 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:32 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e" returned: 0 in 0.580s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:45:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4eb129-723b-4875-b4b2-90fc734324d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece3d131-8a94-4f91-accd-500b6d285125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:32 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Volume volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e (1079b41b-1581-4f5f-a8e1-60ac52969e0e): created successfully Jun 01 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece3d131-8a94-4f91-accd-500b6d285125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Flow 'volume_create_manager' (7d3a372b-c64f-413a-9a03-e6d467aeb47e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:45:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cea00a2b-d4ad-48cc-9042-ce01c307523c tempest-VolumesSnapshotTestJSON-1920383358 None] Created volume successfully. Jun 01 09:45:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] Creating offline snapshot 2fc2931f-f7d5-4826-83bb-57d5b5f2d21f of volume 1079b41b-1581-4f5f-a8e1-60ac52969e0e {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:45:33 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f10c29e-871b-4097-bffb-880314e84d7c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:33 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e Jun 01 09:45:33 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:33 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e" returned: 0 in 0.696s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:33 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f 1G Jun 01 09:45:33 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-c8548c05-394a-4fef-afb6-21424cd02915 req-4eb3547a-2c74-4975-b630-6496b22da9c7 tempest-TestServerVolumeAttachmentScenario-933852407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:34 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f 1G" returned: 0 in 0.721s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:34 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f Jun 01 09:45:34 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:35 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f" returned: 0 in 0.611s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:35 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f is being set with open permissions: ugo+rw Jun 01 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:35 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f Jun 01 09:45:35 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:35 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f" returned: 0 in 0.586s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:35 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.info Jun 01 09:45:35 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:36 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.info" returned: 0 in 0.594s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:36 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.info is being set with open permissions: ugo+rw Jun 01 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:36 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.info Jun 01 09:45:36 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:36 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:45:36 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:37 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.info" returned: 0 in 0.593s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.878s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-c8548c05-394a-4fef-afb6-21424cd02915 req-4eb3547a-2c74-4975-b630-6496b22da9c7 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.680s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8209c3-2a76-4cb1-a0be-b8e0259a7c34]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-c8548c05-394a-4fef-afb6-21424cd02915 req-4eb3547a-2c74-4975-b630-6496b22da9c7 tempest-TestServerVolumeAttachmentScenario-933852407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3a5d8d73-c845-4439-b251-5850540b9096 tempest-VolumesSnapshotTestJSON-1920383358 None] Create snapshot completed successfully Jun 01 09:45:37 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62 Jun 01 09:45:37 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:37 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.595s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:45:37 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-c8548c05-394a-4fef-afb6-21424cd02915 req-4eb3547a-2c74-4975-b630-6496b22da9c7 tempest-TestServerVolumeAttachmentScenario-933852407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62" returned: 0 in 0.748s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-c8548c05-394a-4fef-afb6-21424cd02915 req-4eb3547a-2c74-4975-b630-6496b22da9c7 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.774s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Flow 'volume_create_manager' (6ccfecaf-6c35-442f-b704-4dfe3b0c248b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca27bc33-4566-41b0-b2f5-c3d39f28abb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca27bc33-4566-41b0-b2f5-c3d39f28abb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-699743835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=041164fd-1ee8-4a50-98e9-2aa4ce27bf11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1316b7cf94d4b059f060945271530ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:45:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2fc2931f-f7d5-4826-83bb-57d5b5f2d21f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:45:38Z,use_quota=True,user_id='a216c8c048ad41e6925450f2ec3644f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7555cee0-74d5-4d46-a8e0-6f4dbfcc93ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7555cee0-74d5-4d46-a8e0-6f4dbfcc93ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961820cb-f7c2-48aa-a6fa-08d6a5f26ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961820cb-f7c2-48aa-a6fa-08d6a5f26ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '041164fd-1ee8-4a50-98e9-2aa4ce27bf11', 'volume_name': 'volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11', 'volume_size': 2, 'snapshot_id': '2fc2931f-f7d5-4826-83bb-57d5b5f2d21f'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c4367e-7402-4cd0-90fc-db7fffe78c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c4367e-7402-4cd0-90fc-db7fffe78c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10427b63-abae-4b4f-b886-d4bfd3983a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:37 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Volume 041164fd-1ee8-4a50-98e9-2aa4ce27bf11: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11', 'volume_size': 2, 'snapshot_id': '2fc2931f-f7d5-4826-83bb-57d5b5f2d21f'} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-2fc2931f-f7d5-4826-83bb-57d5b5f2d21f-041164fd-1ee8-4a50-98e9-2aa4ce27bf11" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-2fc2931f-f7d5-4826-83bb-57d5b5f2d21f-041164fd-1ee8-4a50-98e9-2aa4ce27bf11" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Creating volume 041164fd-1ee8-4a50-98e9-2aa4ce27bf11 from snapshot 2fc2931f-f7d5-4826-83bb-57d5b5f2d21f {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-041164fd-1ee8-4a50-98e9-2aa4ce27bf11" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-c8548c05-394a-4fef-afb6-21424cd02915 req-4eb3547a-2c74-4975-b630-6496b22da9c7 tempest-TestServerVolumeAttachmentScenario-933852407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-80bc481b-0154-4110-aee4-7368f7f97a62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2d81bbf-7d7f-4f80-887e-f0c41f9e6d22', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-041164fd-1ee8-4a50-98e9-2aa4ce27bf11" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] snapshot: 2fc2931f-f7d5-4826-83bb-57d5b5f2d21f, volume: 041164fd-1ee8-4a50-98e9-2aa4ce27bf11, {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ed03a1-e645-43e2-a186-a25fb41c8fc0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:38 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-c8548c05-394a-4fef-afb6-21424cd02915 req-4eb3547a-2c74-4975-b630-6496b22da9c7 tempest-TestServerVolumeAttachmentScenario-933852407 None] attachment_update completed successfully. Jun 01 09:45:38 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f Jun 01 09:45:38 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:38 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f" returned: 0 in 0.738s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6756c0c3-4055-4f02-aa5b-41d163be1322]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:38 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e Jun 01 09:45:38 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:39 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e" returned: 0 in 0.730s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:39 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Path /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 01 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:39 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11 Jun 01 09:45:39 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:44 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11" returned: 0 in 4.770s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[909f7c6c-4ce0-490c-8e58-1857d01600a9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:44 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e Jun 01 09:45:44 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:45 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e" returned: 0 in 0.915s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:45 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Image conversion details: src /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e, size 1024.00 MB, duration 4.77 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:45:45 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Converted 1024.00 MB image at 214.64 MB/s Jun 01 09:45:45 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11 is being set with open permissions: ugo+rw Jun 01 09:45:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:45 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11 Jun 01 09:45:45 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:45 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11" returned: 0 in 0.589s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-041164fd-1ee8-4a50-98e9-2aa4ce27bf11" released by "_copy_volume_from_snapshot" :: held 7.845s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-2fc2931f-f7d5-4826-83bb-57d5b5f2d21f-041164fd-1ee8-4a50-98e9-2aa4ce27bf11" released by "_create_volume_from_snapshot" :: held 7.882s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.899s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10427b63-abae-4b4f-b886-d4bfd3983a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11', 'volume_size': 2, 'snapshot_id': '2fc2931f-f7d5-4826-83bb-57d5b5f2d21f'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f098fcf-ddef-4613-86a0-26cde6b7f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:45 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Volume volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11 (041164fd-1ee8-4a50-98e9-2aa4ce27bf11): created successfully Jun 01 09:45:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f098fcf-ddef-4613-86a0-26cde6b7f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Flow 'volume_create_manager' (6ccfecaf-6c35-442f-b704-4dfe3b0c248b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:45:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8c637859-f9e4-4c39-886e-c5d2e2638730 tempest-VolumesSnapshotTestJSON-1920383358 None] Created volume successfully. Jun 01 09:45:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-041164fd-1ee8-4a50-98e9-2aa4ce27bf11-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-041164fd-1ee8-4a50-98e9-2aa4ce27bf11-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-041164fd-1ee8-4a50-98e9-2aa4ce27bf11" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-041164fd-1ee8-4a50-98e9-2aa4ce27bf11" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfad4530-a530-40fe-9fb7-0be0a3e80288]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:46 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11 Jun 01 09:45:46 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:47 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11" returned: 0 in 0.692s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:47 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11 Jun 01 09:45:47 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:48 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-041164fd-1ee8-4a50-98e9-2aa4ce27bf11" returned: 0 in 0.601s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-041164fd-1ee8-4a50-98e9-2aa4ce27bf11" released by "delete_volume" :: held 1.332s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Created reservations ['91c30249-76c7-4a2e-b10c-2ade426594f7', 'b86c703b-81bd-4e7f-aed3-184974eca8ac', '2ee794db-504b-41ac-9d17-603792f8879e', 'cc1dbcb8-a5f8-4f73-9259-7b9ecbf6faf4'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:48 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:45:48 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-85dd4976-d3eb-4a2d-b5bc-adfaeb630af0 req-d0fc0112-b560-471f-b6f6-6e2dbb1b7033 tempest-TestServerVolumeAttachmentScenario-933852407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-85dd4976-d3eb-4a2d-b5bc-adfaeb630af0 req-d0fc0112-b560-471f-b6f6-6e2dbb1b7033 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c5ef03-c76f-40a1-82a3-5d2e95a9c0f9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-85dd4976-d3eb-4a2d-b5bc-adfaeb630af0 req-d0fc0112-b560-471f-b6f6-6e2dbb1b7033 tempest-TestServerVolumeAttachmentScenario-933852407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:48 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d Jun 01 09:45:48 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:48 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.590s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:45:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Deleted volume successfully. Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ca3e11fb-451b-4194-ab16-268a3c374c40 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-041164fd-1ee8-4a50-98e9-2aa4ce27bf11-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-2fc2931f-f7d5-4826-83bb-57d5b5f2d21f-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-2fc2931f-f7d5-4826-83bb-57d5b5f2d21f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-1079b41b-1581-4f5f-a8e1-60ac52969e0e" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-1079b41b-1581-4f5f-a8e1-60ac52969e0e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-2fc2931f-f7d5-4826-83bb-57d5b5f2d21f" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-2fc2931f-f7d5-4826-83bb-57d5b5f2d21f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Deleting offline snapshot 2fc2931f-f7d5-4826-83bb-57d5b5f2d21f of volume 1079b41b-1581-4f5f-a8e1-60ac52969e0e {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:45:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] snapshot_file for this snap is: volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:45:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad24249-25d7-4857-b538-096ac605a638]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:49 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f Jun 01 09:45:49 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:49 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-85dd4976-d3eb-4a2d-b5bc-adfaeb630af0 req-d0fc0112-b560-471f-b6f6-6e2dbb1b7033 tempest-TestServerVolumeAttachmentScenario-933852407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d" returned: 0 in 0.702s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-85dd4976-d3eb-4a2d-b5bc-adfaeb630af0 req-d0fc0112-b560-471f-b6f6-6e2dbb1b7033 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.723s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-85dd4976-d3eb-4a2d-b5bc-adfaeb630af0 req-d0fc0112-b560-471f-b6f6-6e2dbb1b7033 tempest-TestServerVolumeAttachmentScenario-933852407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87a25594-0840-49ad-a5b7-ee5757d59be7', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:45:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-85dd4976-d3eb-4a2d-b5bc-adfaeb630af0 req-d0fc0112-b560-471f-b6f6-6e2dbb1b7033 tempest-TestServerVolumeAttachmentScenario-933852407 None] attachment_update completed successfully. Jun 01 09:45:49 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f" returned: 0 in 0.683s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:45:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa13eb49-ecca-40cd-8d2c-47cc16fe1af5]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:49 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e Jun 01 09:45:49 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:50 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e" returned: 0 in 0.729s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:50 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f Jun 01 09:45:50 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:51 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f" returned: 0 in 0.657s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:51 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f Jun 01 09:45:51 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:51 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e.2fc2931f-f7d5-4826-83bb-57d5b5f2d21f" returned: 0 in 0.569s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-2fc2931f-f7d5-4826-83bb-57d5b5f2d21f" released by "_delete_snapshot" :: held 2.727s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-1079b41b-1581-4f5f-a8e1-60ac52969e0e" released by "delete_snapshot" :: held 2.752s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:51 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Created reservations ['2778da18-1745-43d8-b8f6-9ea27566f9f0', '8850ccaf-c46e-4e81-a4b4-8d03dcac50ce', 'd95a0abf-85ad-4658-99a5-73f8c2d42260', 'f56050d0-6e40-4fa9-8f3b-ebfc1dbd8315'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:45:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Delete snapshot completed successfully. Jun 01 09:45:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dd072b48-b83e-4103-b716-ae1f73764f85 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-2fc2931f-f7d5-4826-83bb-57d5b5f2d21f-delete_snapshot" released by "delete_snapshot" :: held 2.874s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-1079b41b-1581-4f5f-a8e1-60ac52969e0e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-1079b41b-1581-4f5f-a8e1-60ac52969e0e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-1079b41b-1581-4f5f-a8e1-60ac52969e0e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:45:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-1079b41b-1581-4f5f-a8e1-60ac52969e0e" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:45:52 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcebc73-e29a-42ef-90a1-428d6e23746e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:52 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e Jun 01 09:45:52 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:52 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e" returned: 0 in 0.682s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:52 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e Jun 01 09:45:52 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:53 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1079b41b-1581-4f5f-a8e1-60ac52969e0e" returned: 0 in 0.609s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-1079b41b-1581-4f5f-a8e1-60ac52969e0e" released by "delete_volume" :: held 1.351s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:53 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Created reservations ['bd0406a0-fc2f-4364-8cd0-d9aea8adc57c', '6b83cd5a-b755-4173-b529-981d05a77162', 'bc84e253-c73f-4f2e-8a28-50ecfd6f3c94', 'efaa0f60-bb23-4342-a264-de8e1466fbee'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:45:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:45:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:45:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:53 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:45:53 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:54 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.597s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:45:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Deleted volume successfully. Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-56897c68-6233-4483-9ad3-34385dd595ce tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-1079b41b-1581-4f5f-a8e1-60ac52969e0e-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Flow 'volume_create_manager' (cfd7ba1f-b11b-483b-85e0-d74c153e76ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c3b824-6683-49ad-b970-320c4fba51a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c3b824-6683-49ad-b970-320c4fba51a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1717242244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825a8a2e-edb2-450d-bec6-d1c3e8b8699a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1316b7cf94d4b059f060945271530ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:45:55Z,use_quota=True,user_id='a216c8c048ad41e6925450f2ec3644f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547228ff-2b81-40a0-961c-3291feb54043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547228ff-2b81-40a0-961c-3291feb54043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeac96df-aa8c-4cfe-80e6-62f2f52f2e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeac96df-aa8c-4cfe-80e6-62f2f52f2e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '825a8a2e-edb2-450d-bec6-d1c3e8b8699a', 'volume_name': 'volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cf8bad-9920-4d6b-aeac-22362f5c6cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cf8bad-9920-4d6b-aeac-22362f5c6cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1d1669-ed85-4c3f-a1eb-055685886c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:54 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Volume 825a8a2e-edb2-450d-bec6-d1c3e8b8699a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a', 'volume_size': 1} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1717242244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825a8a2e-edb2-450d-bec6-d1c3e8b8699a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1316b7cf94d4b059f060945271530ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:45:55Z,use_quota=True,user_id='a216c8c048ad41e6925450f2ec3644f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Creating volume 825a8a2e-edb2-450d-bec6-d1c3e8b8699a {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:45:54 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:45:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:54 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a 1073741824 Jun 01 09:45:54 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-d193b96a-565b-4db0-a842-3cea1b3599e7 req-8b793d91-2dee-4980-8d4f-539d6cd25cba tempest-TestServerVolumeAttachmentScenario-933852407 None] Terminate volume connection completed successfully. Jun 01 09:45:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-d193b96a-565b-4db0-a842-3cea1b3599e7 req-8b793d91-2dee-4980-8d4f-539d6cd25cba tempest-TestServerVolumeAttachmentScenario-933852407 None] Deleting attachment 87a25594-0840-49ad-a5b7-ee5757d59be7. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:45:55 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a 1073741824" returned: 0 in 0.761s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:55 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a Jun 01 09:45:55 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:56 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a" returned: 0 in 0.597s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:45:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:45:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1d1669-ed85-4c3f-a1eb-055685886c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e28dda64-0f4b-4b18-a1f0-a667b2386d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:45:56 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Volume volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a (825a8a2e-edb2-450d-bec6-d1c3e8b8699a): created successfully Jun 01 09:45:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e28dda64-0f4b-4b18-a1f0-a667b2386d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:45:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Flow 'volume_create_manager' (cfd7ba1f-b11b-483b-85e0-d74c153e76ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:45:56 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fc0c96a1-5400-4097-9252-613684fa55db tempest-VolumesSnapshotTestJSON-1920383358 None] Created volume successfully. Jun 01 09:45:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:45:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:45:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] Creating offline snapshot 7b9e3330-1a7f-4405-a5b1-82154c89be6b of volume 825a8a2e-edb2-450d-bec6-d1c3e8b8699a {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:45:57 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6939beb5-fdd3-4bc0-8ad2-cbd7eab8fa86]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:45:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:57 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a Jun 01 09:45:57 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:57 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a" returned: 0 in 0.701s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:57 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b 1G Jun 01 09:45:57 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:58 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b 1G" returned: 0 in 0.788s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:58 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-d8b82861-54c1-4a59-9b75-94ce53e45617 req-630345ec-8642-4d1a-bcd7-c18b18bfaf83 tempest-TestServerVolumeAttachmentScenario-933852407 None] Terminate volume connection completed successfully. Jun 01 09:45:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-d8b82861-54c1-4a59-9b75-94ce53e45617 req-630345ec-8642-4d1a-bcd7-c18b18bfaf83 tempest-TestServerVolumeAttachmentScenario-933852407 None] Deleting attachment c2d81bbf-7d7f-4f80-887e-f0c41f9e6d22. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:45:58 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b Jun 01 09:45:58 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:59 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b" returned: 0 in 0.627s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:59 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b is being set with open permissions: ugo+rw Jun 01 09:45:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:59 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b Jun 01 09:45:59 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:45:59 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Jun 01 09:45:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b" returned: 0 in 0.584s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:45:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:45:59 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.info Jun 01 09:45:59 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:00 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.info" returned: 0 in 0.609s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:00 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.info is being set with open permissions: ugo+rw Jun 01 09:46:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:00 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.info Jun 01 09:46:00 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:01 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.info" returned: 0 in 0.596s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.989s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-37ed725d-c370-42e7-a124-1deb9029c182 tempest-VolumesSnapshotTestJSON-1920383358 None] Create snapshot completed successfully Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Flow 'volume_create_manager' (f4e0d186-ba1e-49d2-8320-5ffc955ead62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335d7640-e91f-4f49-abe6-ab94589ce122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335d7640-e91f-4f49-abe6-ab94589ce122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2005448896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8f507b-af5f-4162-8d12-b81d79cc274f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1316b7cf94d4b059f060945271530ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7b9e3330-1a7f-4405-a5b1-82154c89be6b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:46:02Z,use_quota=True,user_id='a216c8c048ad41e6925450f2ec3644f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94095820-b196-4016-82b5-cf2b3aabc158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94095820-b196-4016-82b5-cf2b3aabc158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8416dac-2f92-4b3f-9887-e3a15476bef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8416dac-2f92-4b3f-9887-e3a15476bef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fa8f507b-af5f-4162-8d12-b81d79cc274f', 'volume_name': 'volume-fa8f507b-af5f-4162-8d12-b81d79cc274f', 'volume_size': 1, 'snapshot_id': '7b9e3330-1a7f-4405-a5b1-82154c89be6b'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7dac67-0f04-45f6-9874-474f6a9a0ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7dac67-0f04-45f6-9874-474f6a9a0ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533c5ee5-8fd5-4d12-9a6e-4c8838a50e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:01 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Volume fa8f507b-af5f-4162-8d12-b81d79cc274f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fa8f507b-af5f-4162-8d12-b81d79cc274f', 'volume_size': 1, 'snapshot_id': '7b9e3330-1a7f-4405-a5b1-82154c89be6b'} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-7b9e3330-1a7f-4405-a5b1-82154c89be6b-fa8f507b-af5f-4162-8d12-b81d79cc274f" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-7b9e3330-1a7f-4405-a5b1-82154c89be6b-fa8f507b-af5f-4162-8d12-b81d79cc274f" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Creating volume fa8f507b-af5f-4162-8d12-b81d79cc274f from snapshot 7b9e3330-1a7f-4405-a5b1-82154c89be6b {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-fa8f507b-af5f-4162-8d12-b81d79cc274f" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-fa8f507b-af5f-4162-8d12-b81d79cc274f" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] snapshot: 7b9e3330-1a7f-4405-a5b1-82154c89be6b, volume: fa8f507b-af5f-4162-8d12-b81d79cc274f, {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a87108f-b9b0-4080-be38-7def60ec562e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:02 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b Jun 01 09:46:02 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:02 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b" returned: 0 in 0.810s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:46:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 01 09:46:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 01 09:46:02 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6856a26-7355-4d8e-9d83-93d64e6c7b0d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:02 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a Jun 01 09:46:02 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:03 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a" returned: 0 in 0.762s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:03 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Path /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 01 09:46:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:03 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f Jun 01 09:46:03 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:08 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f" returned: 0 in 4.723s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:08 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca634cf-101b-4105-9575-c117764ab1ba]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:08 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a Jun 01 09:46:08 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:09 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a" returned: 0 in 0.882s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Image conversion details: src /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a, size 1024.00 MB, duration 4.72 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:46:09 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Converted 1024.00 MB image at 216.75 MB/s Jun 01 09:46:09 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f is being set with open permissions: ugo+rw Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:09 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f Jun 01 09:46:09 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Acquiring lock "cinder-1334d9b3-0de7-4ff4-ab9d-9673fb49583d-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "cinder-1334d9b3-0de7-4ff4-ab9d-9673fb49583d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Acquiring lock "cinder-quobyte-1334d9b3-0de7-4ff4-ab9d-9673fb49583d" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "cinder-quobyte-1334d9b3-0de7-4ff4-ab9d-9673fb49583d" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bd4c95-846d-491b-9b60-c1bd81f74718]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:09 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d Jun 01 09:46:09 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:09 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f" returned: 0 in 0.580s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-fa8f507b-af5f-4162-8d12-b81d79cc274f" released by "_copy_volume_from_snapshot" :: held 7.905s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-7b9e3330-1a7f-4405-a5b1-82154c89be6b-fa8f507b-af5f-4162-8d12-b81d79cc274f" released by "_create_volume_from_snapshot" :: held 7.992s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533c5ee5-8fd5-4d12-9a6e-4c8838a50e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8f507b-af5f-4162-8d12-b81d79cc274f', 'volume_size': 1, 'snapshot_id': '7b9e3330-1a7f-4405-a5b1-82154c89be6b'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fea7622-957c-42b9-bbcb-8031dbeb4ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:09 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Volume volume-fa8f507b-af5f-4162-8d12-b81d79cc274f (fa8f507b-af5f-4162-8d12-b81d79cc274f): created successfully Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fea7622-957c-42b9-bbcb-8031dbeb4ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Flow 'volume_create_manager' (f4e0d186-ba1e-49d2-8320-5ffc955ead62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:46:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9e933374-3cee-46ba-bb91-0d8c2b82511b tempest-VolumesSnapshotTestJSON-1920383358 None] Created volume successfully. Jun 01 09:46:10 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d" returned: 0 in 0.722s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:10 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d Jun 01 09:46:10 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-fa8f507b-af5f-4162-8d12-b81d79cc274f-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-fa8f507b-af5f-4162-8d12-b81d79cc274f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-fa8f507b-af5f-4162-8d12-b81d79cc274f" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-fa8f507b-af5f-4162-8d12-b81d79cc274f" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d858a79-6378-42a1-ac31-04ffc578bf14]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:10 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1334d9b3-0de7-4ff4-ab9d-9673fb49583d" returned: 0 in 0.565s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "cinder-quobyte-1334d9b3-0de7-4ff4-ab9d-9673fb49583d" released by "delete_volume" :: held 1.333s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:10 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f Jun 01 09:46:10 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Created reservations ['63d2d57e-def7-4596-b685-26a6c3535f9a', '6dbf5d52-cbe5-4797-b13a-3312a079d45e', '8823059b-9028-43cc-af62-f03b523beb28', '837452e1-f1dd-4176-91c7-507f12c494a6'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:10 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:46:10 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:11 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f" returned: 0 in 0.688s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:11 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f Jun 01 09:46:11 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:11 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.600s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:46:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Deleted volume successfully. Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee05e0c8-34c9-46ff-b16d-a0f7e93f7768 tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "cinder-1334d9b3-0de7-4ff4-ab9d-9673fb49583d-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Acquiring lock "cinder-80bc481b-0154-4110-aee4-7368f7f97a62-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "cinder-80bc481b-0154-4110-aee4-7368f7f97a62-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Acquiring lock "cinder-quobyte-80bc481b-0154-4110-aee4-7368f7f97a62" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "cinder-quobyte-80bc481b-0154-4110-aee4-7368f7f97a62" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[5631ad3b-10bf-4126-8432-961f7ff93b7b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:11 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62 Jun 01 09:46:11 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:11 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-fa8f507b-af5f-4162-8d12-b81d79cc274f" returned: 0 in 0.603s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-fa8f507b-af5f-4162-8d12-b81d79cc274f" released by "delete_volume" :: held 1.333s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Created reservations ['fba2b4cf-07c8-4527-964a-e006d646839b', 'ee97839f-6ba1-4244-b009-4792454914be', '70958287-d044-4d62-bb09-58f2e06e93a0', '2edfbb86-88ce-41c3-9ba0-89b0fce197ad'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:12 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:46:12 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:12 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62" returned: 0 in 0.732s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:12 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62 Jun 01 09:46:12 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:12 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.585s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:46:12 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Deleted volume successfully. Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-96f1cda4-3660-453b-900a-71211a57c60c tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-fa8f507b-af5f-4162-8d12-b81d79cc274f-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-7b9e3330-1a7f-4405-a5b1-82154c89be6b-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-7b9e3330-1a7f-4405-a5b1-82154c89be6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-825a8a2e-edb2-450d-bec6-d1c3e8b8699a" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-825a8a2e-edb2-450d-bec6-d1c3e8b8699a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-7b9e3330-1a7f-4405-a5b1-82154c89be6b" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-7b9e3330-1a7f-4405-a5b1-82154c89be6b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Deleting offline snapshot 7b9e3330-1a7f-4405-a5b1-82154c89be6b of volume 825a8a2e-edb2-450d-bec6-d1c3e8b8699a {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] snapshot_file for this snap is: volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37cd336-a3e4-4104-a29f-c21f03400c77]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:12 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b Jun 01 09:46:12 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:12 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-80bc481b-0154-4110-aee4-7368f7f97a62" returned: 0 in 0.638s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "cinder-quobyte-80bc481b-0154-4110-aee4-7368f7f97a62" released by "delete_volume" :: held 1.417s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Created reservations ['726eb19a-6fcb-44c6-9460-96fdcefb0ea2', 'd28e0576-3b78-411b-b6a2-bd8df48df3b8', '10ad2bb5-9228-4913-b8b3-302a74e30d60', '172f2ef9-9f33-4dd0-bfb3-b001a924b340'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:46:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:13 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:46:13 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:13 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b" returned: 0 in 0.709s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:46:13 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed61ee7-d80f-4de4-9f92-31daffb4d6ee]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:13 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a Jun 01 09:46:13 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:13 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.631s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:46:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Deleted volume successfully. Jun 01 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-23c93c76-3eb4-4087-b657-29d42a41ad0e tempest-TestServerVolumeAttachmentScenario-933852407 None] Lock "cinder-80bc481b-0154-4110-aee4-7368f7f97a62-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:14 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a" returned: 0 in 0.733s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:14 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b Jun 01 09:46:14 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b" returned: 0 in 0.734s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:15 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:15 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b Jun 01 09:46:15 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:15 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a.7b9e3330-1a7f-4405-a5b1-82154c89be6b" returned: 0 in 0.621s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-7b9e3330-1a7f-4405-a5b1-82154c89be6b" released by "_delete_snapshot" :: held 2.922s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-825a8a2e-edb2-450d-bec6-d1c3e8b8699a" released by "delete_snapshot" :: held 2.950s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:15 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=83,cinder:UPDATE=67,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:46:15 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Created reservations ['f0f2e34d-16f8-400b-be95-0e31c4460007', 'c5548f25-b224-47f2-8ea7-131e007f591e', '6173c54b-c9df-4fb1-b0d4-5db1cb13de6f', '21bac648-b5b0-43ac-a882-c15a9861560a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:46:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Delete snapshot completed successfully. Jun 01 09:46:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-32205020-2294-494e-8bab-3edcd09dc3fd tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-7b9e3330-1a7f-4405-a5b1-82154c89be6b-delete_snapshot" released by "delete_snapshot" :: held 3.112s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-825a8a2e-edb2-450d-bec6-d1c3e8b8699a-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-825a8a2e-edb2-450d-bec6-d1c3e8b8699a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:16 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=80,cinder:UPDATE=84,cinder:DELETE=7,cinder:INSERT=17 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-825a8a2e-edb2-450d-bec6-d1c3e8b8699a" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-825a8a2e-edb2-450d-bec6-d1c3e8b8699a" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2658e4a-3535-4b6d-be26-d0d6aad8f015]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:16 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a Jun 01 09:46:16 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:16 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a" returned: 0 in 0.780s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:16 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a Jun 01 09:46:16 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:17 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-825a8a2e-edb2-450d-bec6-d1c3e8b8699a" returned: 0 in 0.604s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-825a8a2e-edb2-450d-bec6-d1c3e8b8699a" released by "delete_volume" :: held 1.442s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:17 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Created reservations ['087ca78f-8c49-4288-bc4d-301a9b8c3d10', 'b6610e3c-11ca-4135-ba55-715caf1d16de', 'deb21831-9005-4f06-a504-31820ecd5b84', 'eaa8e5ce-42a2-48b2-84b5-b54441b2de25'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:46:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:17 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:46:17 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:18 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.630s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:18 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:46:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Deleted volume successfully. Jun 01 09:46:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-a46ce4ef-15b0-41d3-b698-aa7300ddafb8-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0faa27b0-88cc-481d-8087-644ad1a6c256 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-825a8a2e-edb2-450d-bec6-d1c3e8b8699a-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-a46ce4ef-15b0-41d3-b698-aa7300ddafb8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "cinder-quobyte-a46ce4ef-15b0-41d3-b698-aa7300ddafb8" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-a46ce4ef-15b0-41d3-b698-aa7300ddafb8" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d2ff6c-c6e6-4c60-a80b-d2160612e109]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:18 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 Jun 01 09:46:18 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:19 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8" returned: 0 in 0.729s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:19 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8 Jun 01 09:46:19 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:19 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a46ce4ef-15b0-41d3-b698-aa7300ddafb8" returned: 0 in 0.626s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-quobyte-a46ce4ef-15b0-41d3-b698-aa7300ddafb8" released by "delete_volume" :: held 1.411s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:19 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Created reservations ['460638ca-de50-4d23-ac17-b399c4ea9940', '3473b214-8899-4372-bfe3-c2da185bea2b', '927ba08d-a7e9-4c73-95b0-db0ab7cedfb6', 'ea154263-427a-427b-a8a0-8699da92a3c3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:46:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:19 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:46:19 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:20 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.625s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:20 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:46:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Deleted volume successfully. Jun 01 09:46:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-50279726-8a56-4cf1-b117-1e3df748e5b4 tempest-VolumesSnapshotTestJSON-1920383358 None] Lock "cinder-a46ce4ef-15b0-41d3-b698-aa7300ddafb8-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Flow 'volume_create_manager' (254a8446-dc25-4d58-8d8b-174713d41cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6ead55-b1b6-4b0a-9447-2e06db5b00ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6ead55-b1b6-4b0a-9447-2e06db5b00ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1686606310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801bb5ed-321a-45a1-b5be-5edbfd6de5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6cbfa55944cb2bb52739e1b53fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:46:26Z,use_quota=True,user_id='2263b16e80fa4cad977b3d64ccd2cc2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7efff0c-d15f-4ff2-ba41-73e3a61835a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7efff0c-d15f-4ff2-ba41-73e3a61835a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86de60c-59a3-4f2f-8d21-f4bd517a4d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86de60c-59a3-4f2f-8d21-f4bd517a4d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '801bb5ed-321a-45a1-b5be-5edbfd6de5ad', 'volume_name': 'volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09820c65-439f-4039-845e-7299e2d2a2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09820c65-439f-4039-845e-7299e2d2a2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b81072-b8ff-45b5-96b9-1a12765593fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:26 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Volume 801bb5ed-321a-45a1-b5be-5edbfd6de5ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad', 'volume_size': 1} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1686606310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801bb5ed-321a-45a1-b5be-5edbfd6de5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6cbfa55944cb2bb52739e1b53fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:46:26Z,use_quota=True,user_id='2263b16e80fa4cad977b3d64ccd2cc2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Creating volume 801bb5ed-321a-45a1-b5be-5edbfd6de5ad {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:46:26 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:26 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad 1073741824 Jun 01 09:46:26 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Flow 'volume_create_manager' (a4c2e4ad-6c27-47b3-b933-c5becae5006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b4104c-84f9-41c8-aea0-15e829c0369e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b4104c-84f9-41c8-aea0-15e829c0369e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-981525507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2622740b-9ffd-4c3a-bd9f-d6abc6721223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6cbfa55944cb2bb52739e1b53fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:46:27Z,use_quota=True,user_id='2263b16e80fa4cad977b3d64ccd2cc2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da36ba65-1d94-4d2c-af71-a4babb05a21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da36ba65-1d94-4d2c-af71-a4babb05a21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2c92b8-0b90-4035-b470-affd12e6ce8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2c92b8-0b90-4035-b470-affd12e6ce8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2622740b-9ffd-4c3a-bd9f-d6abc6721223', 'volume_name': 'volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c5ba75-8b30-402c-8565-5a2cd07fbcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c5ba75-8b30-402c-8565-5a2cd07fbcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b002020-1dbd-4002-9077-7b147328b253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:26 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Volume 2622740b-9ffd-4c3a-bd9f-d6abc6721223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223', 'volume_size': 1} Jun 01 09:46:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Flow 'volume_create_manager' (102a7d7e-19f5-4449-8f1e-e48343061f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec6eb77-b09d-43a2-9cf9-88cdf97faa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec6eb77-b09d-43a2-9cf9-88cdf97faa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-641661068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6cbfa55944cb2bb52739e1b53fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:46:27Z,use_quota=True,user_id='2263b16e80fa4cad977b3d64ccd2cc2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5672db-90b6-4561-b71c-3fe41aac5292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5672db-90b6-4561-b71c-3fe41aac5292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eceff3cc-ce34-49db-8deb-7fb67b6547b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eceff3cc-ce34-49db-8deb-7fb67b6547b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8', 'volume_name': 'volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0792ddd8-6a63-4114-be2a-b250ffecd99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0792ddd8-6a63-4114-be2a-b250ffecd99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942b6c2e-f633-47f0-94ef-730ea79cd323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:27 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Volume 8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8', 'volume_size': 1} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:46:27 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Flow 'volume_create_manager' (cfe1e2eb-88e9-4849-b8b0-906320da7b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13fae99-3859-435b-8735-986f03aba941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad 1073741824" returned: 0 in 1.253s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13fae99-3859-435b-8735-986f03aba941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-92733375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6cbfa55944cb2bb52739e1b53fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:46:28Z,use_quota=True,user_id='2263b16e80fa4cad977b3d64ccd2cc2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9efdf3d4-190c-4d4e-9ee9-54c61bf6ec50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9efdf3d4-190c-4d4e-9ee9-54c61bf6ec50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0828591-3194-44d0-a9a8-df5b1dceaa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0828591-3194-44d0-a9a8-df5b1dceaa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7', 'volume_name': 'volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5afd39da-f726-4a14-a116-0042fcbed998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5afd39da-f726-4a14-a116-0042fcbed998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc353c4-8279-4f63-8e6d-014868caf297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:27 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Volume ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7', 'volume_size': 1} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:27 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad Jun 01 09:46:27 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Flow 'volume_create_manager' (01541200-f1a0-4d48-9642-26797a878c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3447057-934c-4848-b752-27b102d39454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3447057-934c-4848-b752-27b102d39454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-375545718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689c32e7-ebfe-49ab-8ef3-843591384799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6cbfa55944cb2bb52739e1b53fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:46:28Z,use_quota=True,user_id='2263b16e80fa4cad977b3d64ccd2cc2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7eb44f4-3ce2-457c-b803-81914162c73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7eb44f4-3ce2-457c-b803-81914162c73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed644a60-ae9b-4368-9a74-0ee6f7a57e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed644a60-ae9b-4368-9a74-0ee6f7a57e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '689c32e7-ebfe-49ab-8ef3-843591384799', 'volume_name': 'volume-689c32e7-ebfe-49ab-8ef3-843591384799', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de101aa-d041-40ec-b0d3-e70f613ee226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de101aa-d041-40ec-b0d3-e70f613ee226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f498bf-1b8b-4500-9c9a-9ad4f09d7fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Volume 689c32e7-ebfe-49ab-8ef3-843591384799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-689c32e7-ebfe-49ab-8ef3-843591384799', 'volume_size': 1} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:28 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad" returned: 0 in 0.790s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] <== create_volume: return (2129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.680s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-981525507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2622740b-9ffd-4c3a-bd9f-d6abc6721223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6cbfa55944cb2bb52739e1b53fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:46:27Z,use_quota=True,user_id='2263b16e80fa4cad977b3d64ccd2cc2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Creating volume 2622740b-9ffd-4c3a-bd9f-d6abc6721223 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:46:28 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:28 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223 1073741824 Jun 01 09:46:28 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b81072-b8ff-45b5-96b9-1a12765593fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20e21ac-7b60-48a8-935e-bb0d9d348f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Volume volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad (801bb5ed-321a-45a1-b5be-5edbfd6de5ad): created successfully Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20e21ac-7b60-48a8-935e-bb0d9d348f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Flow 'volume_create_manager' (254a8446-dc25-4d58-8d8b-174713d41cdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:46:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-14f87a0d-01b3-4c0d-86f5-ae0b5ebd2c49 tempest-CreateVolumesFromImageTest-1905418446 None] Created volume successfully. Jun 01 09:46:29 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223 1073741824" returned: 0 in 0.846s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:29 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223 Jun 01 09:46:29 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:30 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223" returned: 0 in 0.600s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.760s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-641661068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6cbfa55944cb2bb52739e1b53fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:46:27Z,use_quota=True,user_id='2263b16e80fa4cad977b3d64ccd2cc2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Creating volume 8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:46:30 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:30 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8 1073741824 Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b002020-1dbd-4002-9077-7b147328b253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:30 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125aac6f-c3d0-436b-a934-909d250b984c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:30 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Volume volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223 (2622740b-9ffd-4c3a-bd9f-d6abc6721223): created successfully Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125aac6f-c3d0-436b-a934-909d250b984c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Flow 'volume_create_manager' (a4c2e4ad-6c27-47b3-b933-c5becae5006e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:46:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2fda23e9-8899-4641-84a9-dcab4da11789 tempest-CreateVolumesFromImageTest-1905418446 None] Created volume successfully. Jun 01 09:46:30 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8 1073741824" returned: 0 in 0.833s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:30 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8 Jun 01 09:46:30 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:31 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8" returned: 0 in 0.593s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.785s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-92733375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6cbfa55944cb2bb52739e1b53fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:46:28Z,use_quota=True,user_id='2263b16e80fa4cad977b3d64ccd2cc2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Creating volume ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:46:31 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:31 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7 1073741824 Jun 01 09:46:31 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942b6c2e-f633-47f0-94ef-730ea79cd323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (462fe56e-db6e-4ff8-856b-0eb79b239f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:31 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Volume volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8 (8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8): created successfully Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (462fe56e-db6e-4ff8-856b-0eb79b239f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Flow 'volume_create_manager' (102a7d7e-19f5-4449-8f1e-e48343061f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:46:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-bb6621fb-cbb9-407e-9814-d39e8a78096a tempest-CreateVolumesFromImageTest-1905418446 None] Created volume successfully. Jun 01 09:46:32 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7 1073741824" returned: 0 in 0.863s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:32 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7 Jun 01 09:46:32 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:33 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7" returned: 0 in 0.674s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.869s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-375545718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689c32e7-ebfe-49ab-8ef3-843591384799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6cbfa55944cb2bb52739e1b53fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:46:28Z,use_quota=True,user_id='2263b16e80fa4cad977b3d64ccd2cc2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Creating volume 689c32e7-ebfe-49ab-8ef3-843591384799 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:46:33 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-689c32e7-ebfe-49ab-8ef3-843591384799 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc353c4-8279-4f63-8e6d-014868caf297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:33 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-689c32e7-ebfe-49ab-8ef3-843591384799 1073741824 Jun 01 09:46:33 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febda1af-9873-4a87-9b3c-bbee4ee357bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:33 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Volume volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7 (ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7): created successfully Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febda1af-9873-4a87-9b3c-bbee4ee357bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Flow 'volume_create_manager' (cfe1e2eb-88e9-4849-b8b0-906320da7b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:46:33 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1274ecf4-f018-4b90-a0ac-5988dfbb7709 tempest-CreateVolumesFromImageTest-1905418446 None] Created volume successfully. Jun 01 09:46:33 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-689c32e7-ebfe-49ab-8ef3-843591384799 1073741824" returned: 0 in 0.791s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-689c32e7-ebfe-49ab-8ef3-843591384799 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:34 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-689c32e7-ebfe-49ab-8ef3-843591384799 Jun 01 09:46:34 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:34 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-689c32e7-ebfe-49ab-8ef3-843591384799" returned: 0 in 0.620s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:46:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f498bf-1b8b-4500-9c9a-9ad4f09d7fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-689c32e7-ebfe-49ab-8ef3-843591384799', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ec335f-9697-4893-8d5f-67399a7127b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:34 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Volume volume-689c32e7-ebfe-49ab-8ef3-843591384799 (689c32e7-ebfe-49ab-8ef3-843591384799): created successfully Jun 01 09:46:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ec335f-9697-4893-8d5f-67399a7127b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Flow 'volume_create_manager' (01541200-f1a0-4d48-9642-26797a878c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:46:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c873dab5-430a-4257-bb10-9163c6c6de67 tempest-CreateVolumesFromImageTest-1905418446 None] Created volume successfully. Jun 01 09:46:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "cinder-689c32e7-ebfe-49ab-8ef3-843591384799-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-689c32e7-ebfe-49ab-8ef3-843591384799-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "cinder-quobyte-689c32e7-ebfe-49ab-8ef3-843591384799" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-quobyte-689c32e7-ebfe-49ab-8ef3-843591384799" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fcb2c3-64fe-4cf8-98c1-ee0ed69a6ac9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-689c32e7-ebfe-49ab-8ef3-843591384799 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:35 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-689c32e7-ebfe-49ab-8ef3-843591384799 Jun 01 09:46:35 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:35 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-689c32e7-ebfe-49ab-8ef3-843591384799" returned: 0 in 0.698s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-689c32e7-ebfe-49ab-8ef3-843591384799 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:35 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-689c32e7-ebfe-49ab-8ef3-843591384799 Jun 01 09:46:35 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:36 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-689c32e7-ebfe-49ab-8ef3-843591384799" returned: 0 in 0.616s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-quobyte-689c32e7-ebfe-49ab-8ef3-843591384799" released by "delete_volume" :: held 1.358s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Created reservations ['298c70db-1bdb-429e-88d4-76fce238133a', '084356f5-715a-451b-b443-b0b73682559d', '964631b4-f085-4e3a-a7d6-5c60471f6753', 'ea6015f5-b2b5-47b1-9904-47b488232ca0'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:36 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:46:36 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:36 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:46:36 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:37 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.647s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:46:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Deleted volume successfully. Jun 01 09:46:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88deb68c-7100-4c18-a923-25346f915b9e tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-689c32e7-ebfe-49ab-8ef3-843591384799-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "cinder-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "cinder-quobyte-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-quobyte-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[feef3c19-87c8-42b4-a931-01329b7d5131]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:37 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7 Jun 01 09:46:37 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:37 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.663s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:46:38 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7" returned: 0 in 0.784s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:38 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7 Jun 01 09:46:38 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:38 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7" returned: 0 in 0.609s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-quobyte-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7" released by "delete_volume" :: held 1.439s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:38 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Created reservations ['1fa717a4-427b-4134-8d08-d3cec9da3df4', 'fb89e107-0de3-4bf9-80fe-b1cdc4e1c000', '6698eff0-7f71-4e65-b817-43aa4f58cce1', 'dd72f1cb-0395-48f7-9004-ba894513bbd0'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:46:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:38 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:46:38 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:39 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.604s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:39 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:46:39 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Deleted volume successfully. Jun 01 09:46:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "cinder-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c53fff7a-b28b-48cc-9e8c-da85321ad117 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-ee1e6f01-fd50-4940-8bfe-dcdfe08ee5b7-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "cinder-quobyte-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-quobyte-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91f0589-ed53-419c-8685-2dd237d43ff8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:39 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8 Jun 01 09:46:39 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:40 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8" returned: 0 in 0.751s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:40 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8 Jun 01 09:46:40 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:40 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8" returned: 0 in 0.628s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-quobyte-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8" released by "delete_volume" :: held 1.425s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:40 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Created reservations ['8a3eb60c-793a-4710-aba1-f2c517964ae6', '3d782977-c14f-430d-a18d-b91475a6bb7f', 'd0b5543c-e118-47b7-8fbf-bf0fc3e965b2', '625641bf-7ae7-46af-b62e-294c4fa1d910'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:41 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:46:41 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:41 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.614s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:46:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Deleted volume successfully. Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "cinder-2622740b-9ffd-4c3a-bd9f-d6abc6721223-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-2622740b-9ffd-4c3a-bd9f-d6abc6721223-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c55b15ee-2121-4e8e-a7a9-dc471b5bbc39 tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-8e3e4f7c-ec1a-4f59-a7eb-31ff9d18a5b8-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "cinder-quobyte-2622740b-9ffd-4c3a-bd9f-d6abc6721223" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-quobyte-2622740b-9ffd-4c3a-bd9f-d6abc6721223" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8a0aad-b1b5-47fd-8d9b-f736d4282eaa]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:41 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223 Jun 01 09:46:41 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:42 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223" returned: 0 in 0.724s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:42 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223 Jun 01 09:46:42 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:43 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2622740b-9ffd-4c3a-bd9f-d6abc6721223" returned: 0 in 0.733s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-quobyte-2622740b-9ffd-4c3a-bd9f-d6abc6721223" released by "delete_volume" :: held 1.543s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:43 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Created reservations ['ceadf1ae-285e-4535-9903-04644533be94', '3e4fb628-22b2-4a43-ba52-220ba50b501f', '1e86d4e8-243e-44b5-a097-1c563a908214', 'ce2bd6b9-c587-4efb-b44c-74c235cf19c7'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:46:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:43 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:46:43 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "cinder-801bb5ed-321a-45a1-b5be-5edbfd6de5ad-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-801bb5ed-321a-45a1-b5be-5edbfd6de5ad-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "cinder-quobyte-801bb5ed-321a-45a1-b5be-5edbfd6de5ad" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:46:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-quobyte-801bb5ed-321a-45a1-b5be-5edbfd6de5ad" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:46:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cb3e02-72e4-44b5-b86d-1d426ef3e071]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:46:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:44 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.670s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:44 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:46:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Deleted volume successfully. Jun 01 09:46:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b8d8c42-b48c-4666-937e-979989bb7dba tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-2622740b-9ffd-4c3a-bd9f-d6abc6721223-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:44 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad Jun 01 09:46:44 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:44 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad" returned: 0 in 0.760s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:44 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad Jun 01 09:46:44 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:45 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-801bb5ed-321a-45a1-b5be-5edbfd6de5ad" returned: 0 in 0.619s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-quobyte-801bb5ed-321a-45a1-b5be-5edbfd6de5ad" released by "delete_volume" :: held 1.440s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Created reservations ['dfa7ae21-51de-4d12-b102-894c29cfcf9c', '71cb9979-7794-49b3-8cd9-124b9d8bea36', '8a436bde-78e8-4ef3-95ff-26e55ae99802', '01543942-0718-47ee-aeed-7d9e9d4f2e13'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:45 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:46:45 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Flow 'volume_create_manager' (2e5987f6-dd99-4f07-a614-997db761bdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bf636f-8656-4b07-9170-a8cd228c5487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bf636f-8656-4b07-9170-a8cd228c5487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1457808088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b14a195-cc88-4319-b81f-1440573c3ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc33689189549b2acd08fb0c1580f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:46:46Z,use_quota=True,user_id='a112f37cc66a4539acae84fd61c269b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d612c5d4-62f7-4645-a327-36d5e4c071b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d612c5d4-62f7-4645-a327-36d5e4c071b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd31e9ef-9b2c-4d1d-ba7b-c7b0356e023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd31e9ef-9b2c-4d1d-ba7b-c7b0356e023e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b14a195-cc88-4319-b81f-1440573c3ff2', 'volume_name': 'volume-2b14a195-cc88-4319-b81f-1440573c3ff2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42356dad-ca5b-4790-b17f-38287cdb7914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42356dad-ca5b-4790-b17f-38287cdb7914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff6d12c-c992-4fae-9f5e-3bcda3f0a4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:45 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Volume 2b14a195-cc88-4319-b81f-1440573c3ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b14a195-cc88-4319-b81f-1440573c3ff2', 'volume_size': 1} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1457808088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b14a195-cc88-4319-b81f-1440573c3ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc33689189549b2acd08fb0c1580f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:46:46Z,use_quota=True,user_id='a112f37cc66a4539acae84fd61c269b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Creating volume 2b14a195-cc88-4319-b81f-1440573c3ff2 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:46:45 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:46:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:45 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 1073741824 Jun 01 09:46:45 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:46 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.606s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:46 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:46:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Deleted volume successfully. Jun 01 09:46:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-04fe873a-7b1e-4249-bb27-f0cd03de138b tempest-CreateVolumesFromImageTest-1905418446 None] Lock "cinder-801bb5ed-321a-45a1-b5be-5edbfd6de5ad-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:46:46 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 1073741824" returned: 0 in 0.840s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:46:46 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 Jun 01 09:46:46 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:46:47 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jun 01 09:46:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2" returned: 0 in 0.701s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:46:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:46:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:46:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff6d12c-c992-4fae-9f5e-3bcda3f0a4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b14a195-cc88-4319-b81f-1440573c3ff2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420fd914-9719-4a93-bc58-c1e6d8557d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:46:47 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Volume volume-2b14a195-cc88-4319-b81f-1440573c3ff2 (2b14a195-cc88-4319-b81f-1440573c3ff2): created successfully Jun 01 09:46:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420fd914-9719-4a93-bc58-c1e6d8557d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:46:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Flow 'volume_create_manager' (2e5987f6-dd99-4f07-a614-997db761bdde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:46:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c2bd2479-c775-468d-b56e-560121e3f81c tempest-TestStampPattern-46570907 None] Created volume successfully. Jun 01 09:46:57 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=47,cinder:INSERT=23,cinder:UPDATE=78,cinder:DELETE=5 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:46:57 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=49,cinder:INSERT=13,cinder:UPDATE=75,cinder:DELETE=8 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:47:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-4e73a061-8824-462c-b4b3-23284e7231e2 req-f8e6edf3-f602-4a2f-b477-20afd0369558 tempest-TestStampPattern-46570907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:47:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-4e73a061-8824-462c-b4b3-23284e7231e2 req-f8e6edf3-f602-4a2f-b477-20afd0369558 tempest-TestStampPattern-46570907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:47:26 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[99784978-22a4-4718-b860-2bfddc861301]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:47:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-4e73a061-8824-462c-b4b3-23284e7231e2 req-f8e6edf3-f602-4a2f-b477-20afd0369558 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:47:26 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 Jun 01 09:47:26 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:47:26 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jun 01 09:47:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-4e73a061-8824-462c-b4b3-23284e7231e2 req-f8e6edf3-f602-4a2f-b477-20afd0369558 tempest-TestStampPattern-46570907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2" returned: 0 in 0.706s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:47:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-4e73a061-8824-462c-b4b3-23284e7231e2 req-f8e6edf3-f602-4a2f-b477-20afd0369558 tempest-TestStampPattern-46570907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.722s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:47:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-4e73a061-8824-462c-b4b3-23284e7231e2 req-f8e6edf3-f602-4a2f-b477-20afd0369558 tempest-TestStampPattern-46570907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-2b14a195-cc88-4319-b81f-1440573c3ff2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '005c56cb-b712-4d41-af72-63ed9ae8e02e', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:47:27 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-4e73a061-8824-462c-b4b3-23284e7231e2 req-f8e6edf3-f602-4a2f-b477-20afd0369558 tempest-TestStampPattern-46570907 None] attachment_update completed successfully. Jun 01 09:47:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-5080d1cc-fc0e-42a1-8681-b35624a5be53 req-b40cff1e-46fb-4bcd-9ba6-647f4a23d757 tempest-TestStampPattern-46570907 None] Terminate volume connection completed successfully. Jun 01 09:47:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-5080d1cc-fc0e-42a1-8681-b35624a5be53 req-b40cff1e-46fb-4bcd-9ba6-647f4a23d757 tempest-TestStampPattern-46570907 None] Deleting attachment 005c56cb-b712-4d41-af72-63ed9ae8e02e. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:47:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:47:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:47:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:47:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:47:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:47:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:47:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:47:36 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:47:36 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:47:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:47:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:47:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] Creating offline snapshot 82ce6366-0819-421e-a7b0-79ecbe404890 of volume 2b14a195-cc88-4319-b81f-1440573c3ff2 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:47:36 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2571a2cf-7ea8-42dc-a246-3ec860ae0871]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:47:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:47:37 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 Jun 01 09:47:37 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:47:37 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jun 01 09:47:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.598s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:47:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:47:37 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Jun 01 09:47:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2" returned: 0 in 0.693s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:47:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:47:37 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 1G Jun 01 09:47:37 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:47:38 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Jun 01 09:47:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 1G" returned: 0 in 0.710s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:47:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b14a195-cc88-4319-b81f-1440573c3ff2 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:47:38 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b14a195-cc88-4319-b81f-1440573c3ff2 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 Jun 01 09:47:38 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:47:38 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Jun 01 09:47:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b14a195-cc88-4319-b81f-1440573c3ff2 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890" returned: 0 in 0.608s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:47:38 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 is being set with open permissions: ugo+rw Jun 01 09:47:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:47:38 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 Jun 01 09:47:38 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:47:39 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jun 01 09:47:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890" returned: 0 in 0.588s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:47:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:47:39 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.info Jun 01 09:47:39 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:47:40 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jun 01 09:47:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.info" returned: 0 in 0.569s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:47:40 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.info is being set with open permissions: ugo+rw Jun 01 09:47:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:47:40 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.info Jun 01 09:47:40 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:47:40 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Jun 01 09:47:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.info" returned: 0 in 0.576s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:47:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.830s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:47:40 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-491db73a-1f26-42cd-ba9b-8dcd77561ec2 tempest-TestStampPattern-46570907 None] Create snapshot completed successfully Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Flow 'volume_create_manager' (1e7ef74f-2221-4914-bd66-7857b3c48a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ca5884-ad7c-49b6-990e-2ce24c9bee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ca5884-ad7c-49b6-990e-2ce24c9bee14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-829569039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef1093b-d90d-40c1-a00d-f260ff535ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc33689189549b2acd08fb0c1580f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=82ce6366-0819-421e-a7b0-79ecbe404890,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:47:50Z,use_quota=True,user_id='a112f37cc66a4539acae84fd61c269b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4adf6d-e207-473f-a649-5dc784122012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4adf6d-e207-473f-a649-5dc784122012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0712141f-b1e8-4769-8121-5679e442c5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0712141f-b1e8-4769-8121-5679e442c5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0ef1093b-d90d-40c1-a00d-f260ff535ee2', 'volume_name': 'volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2', 'volume_size': 1, 'snapshot_id': '82ce6366-0819-421e-a7b0-79ecbe404890'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0fb1ea-6dd9-4219-b971-e6d5262cbd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0fb1ea-6dd9-4219-b971-e6d5262cbd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9b8646-41c0-467e-8d2b-f151b39d9557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:47:49 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Volume 0ef1093b-d90d-40c1-a00d-f260ff535ee2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2', 'volume_size': 1, 'snapshot_id': '82ce6366-0819-421e-a7b0-79ecbe404890'} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Acquiring lock "cinder-quobyte-82ce6366-0819-421e-a7b0-79ecbe404890-0ef1093b-d90d-40c1-a00d-f260ff535ee2" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Lock "cinder-quobyte-82ce6366-0819-421e-a7b0-79ecbe404890-0ef1093b-d90d-40c1-a00d-f260ff535ee2" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Creating volume 0ef1093b-d90d-40c1-a00d-f260ff535ee2 from snapshot 82ce6366-0819-421e-a7b0-79ecbe404890 {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Acquiring lock "cinder-quobyte-0ef1093b-d90d-40c1-a00d-f260ff535ee2" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Lock "cinder-quobyte-0ef1093b-d90d-40c1-a00d-f260ff535ee2" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] snapshot: 82ce6366-0819-421e-a7b0-79ecbe404890, volume: 0ef1093b-d90d-40c1-a00d-f260ff535ee2, {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[03684dc8-79fa-42bc-a01b-604494b77878]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:47:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:47:49 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 Jun 01 09:47:49 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:47:50 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Jun 01 09:47:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890" returned: 0 in 0.742s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:47:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b14a195-cc88-4319-b81f-1440573c3ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:47:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 01 09:47:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 01 09:47:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[914857e3-9f37-476b-b8dd-948bdd16bc77]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:47:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:47:50 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 Jun 01 09:47:50 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:47:51 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Jun 01 09:47:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2" returned: 0 in 0.714s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:47:51 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Path /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 01 09:47:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:47:51 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2 Jun 01 09:47:51 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:47:55 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Jun 01 09:47:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2" returned: 0 in 4.733s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:47:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecbba9d-b08d-4665-81ab-382a0b48865e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:47:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:47:56 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 Jun 01 09:47:56 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:47:56 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Jun 01 09:47:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2" returned: 0 in 0.956s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:47:56 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Image conversion details: src /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2, size 1024.00 MB, duration 4.73 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:47:56 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Converted 1024.00 MB image at 216.28 MB/s Jun 01 09:47:56 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2 is being set with open permissions: ugo+rw Jun 01 09:47:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:47:56 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2 Jun 01 09:47:56 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:47:57 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jun 01 09:47:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2" returned: 0 in 0.694s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:47:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Lock "cinder-quobyte-0ef1093b-d90d-40c1-a00d-f260ff535ee2" released by "_copy_volume_from_snapshot" :: held 7.930s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:47:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Lock "cinder-quobyte-82ce6366-0819-421e-a7b0-79ecbe404890-0ef1093b-d90d-40c1-a00d-f260ff535ee2" released by "_create_volume_from_snapshot" :: held 7.968s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:47:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.983s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:47:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9b8646-41c0-467e-8d2b-f151b39d9557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2', 'volume_size': 1, 'snapshot_id': '82ce6366-0819-421e-a7b0-79ecbe404890'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:47:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e670e7ca-55e6-4dfd-83b4-7834d3926fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:47:57 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Volume volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2 (0ef1093b-d90d-40c1-a00d-f260ff535ee2): created successfully Jun 01 09:47:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e670e7ca-55e6-4dfd-83b4-7834d3926fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:47:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Flow 'volume_create_manager' (1e7ef74f-2221-4914-bd66-7857b3c48a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:47:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7d74e370-b509-493c-ac15-22217ba3ec38 tempest-TestStampPattern-46570907 None] Created volume successfully. Jun 01 09:48:07 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:48:07 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:48:25 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:48:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:48:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:48:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:48:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:48:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:48:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:48:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:48:36 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:48:36 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:48:37 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Jun 01 09:48:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.583s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:48:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:48:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-df559c99-1590-4157-8b11-1fac4fa41fdb req-3bf2c980-0c23-4d63-a920-441b5aab94dc tempest-TestStampPattern-46570907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:48:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-df559c99-1590-4157-8b11-1fac4fa41fdb req-3bf2c980-0c23-4d63-a920-441b5aab94dc tempest-TestStampPattern-46570907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:48:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea3efcc-36b6-4af2-b72b-c43a73f896c8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:48:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-df559c99-1590-4157-8b11-1fac4fa41fdb req-3bf2c980-0c23-4d63-a920-441b5aab94dc tempest-TestStampPattern-46570907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:48:46 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2 Jun 01 09:48:46 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:48:46 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Jun 01 09:48:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-df559c99-1590-4157-8b11-1fac4fa41fdb req-3bf2c980-0c23-4d63-a920-441b5aab94dc tempest-TestStampPattern-46570907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2" returned: 0 in 0.696s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:48:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-df559c99-1590-4157-8b11-1fac4fa41fdb req-3bf2c980-0c23-4d63-a920-441b5aab94dc tempest-TestStampPattern-46570907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.714s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:48:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-df559c99-1590-4157-8b11-1fac4fa41fdb req-3bf2c980-0c23-4d63-a920-441b5aab94dc tempest-TestStampPattern-46570907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10', 'name': 'volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c0a117f-617d-4f32-a41a-577f5b14da63', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 01 09:48:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-df559c99-1590-4157-8b11-1fac4fa41fdb req-3bf2c980-0c23-4d63-a920-441b5aab94dc tempest-TestStampPattern-46570907 None] attachment_update completed successfully. Jun 01 09:48:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-1bfc6b33-eab8-4d85-9041-ae4ea6c717b9 req-8221f0bf-bfb2-4751-aaae-45533c53f2db tempest-TestStampPattern-46570907 None] Terminate volume connection completed successfully. Jun 01 09:48:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-1bfc6b33-eab8-4d85-9041-ae4ea6c717b9 req-8221f0bf-bfb2-4751-aaae-45533c53f2db tempest-TestStampPattern-46570907 None] Deleting attachment 6c0a117f-617d-4f32-a41a-577f5b14da63. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 01 09:48:56 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=7 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:49:02 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:49:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Acquiring lock "cinder-0ef1093b-d90d-40c1-a00d-f260ff535ee2-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Lock "cinder-0ef1093b-d90d-40c1-a00d-f260ff535ee2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Acquiring lock "cinder-quobyte-0ef1093b-d90d-40c1-a00d-f260ff535ee2" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Lock "cinder-quobyte-0ef1093b-d90d-40c1-a00d-f260ff535ee2" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fe069c-e612-4cc5-a376-26b9a8c6764f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:03 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2 Jun 01 09:49:03 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:04 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2" returned: 0 in 0.684s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:04 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2 Jun 01 09:49:04 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:04 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0ef1093b-d90d-40c1-a00d-f260ff535ee2" returned: 0 in 0.583s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Lock "cinder-quobyte-0ef1093b-d90d-40c1-a00d-f260ff535ee2" released by "delete_volume" :: held 1.308s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:04 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Created reservations ['c7288e50-7979-4426-9300-4e22c85423b6', '7dc05e83-86ae-422a-9129-334b0eb5fa84', 'f44db93c-a4cf-471d-8bb8-ecd1cb77152f', '966ac4d2-39b2-41cb-8ade-ce047bfb5aa8'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:49:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:49:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:49:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:49:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:49:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:49:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:04 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:49:04 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:05 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.585s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:05 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:49:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Deleted volume successfully. Jun 01 09:49:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f735dd8a-18f7-49de-9964-08b9ff804f4c tempest-TestStampPattern-46570907 None] Lock "cinder-0ef1093b-d90d-40c1-a00d-f260ff535ee2-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Acquiring lock "cinder-82ce6366-0819-421e-a7b0-79ecbe404890-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Lock "cinder-82ce6366-0819-421e-a7b0-79ecbe404890-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Acquiring lock "cinder-quobyte-2b14a195-cc88-4319-b81f-1440573c3ff2" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Lock "cinder-quobyte-2b14a195-cc88-4319-b81f-1440573c3ff2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Acquiring lock "cinder-quobyte-82ce6366-0819-421e-a7b0-79ecbe404890" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Lock "cinder-quobyte-82ce6366-0819-421e-a7b0-79ecbe404890" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Deleting offline snapshot 82ce6366-0819-421e-a7b0-79ecbe404890 of volume 2b14a195-cc88-4319-b81f-1440573c3ff2 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:49:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] snapshot_file for this snap is: volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:49:05 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[55324f33-db96-48cb-b220-488e5ea16643]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:05 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 Jun 01 09:49:05 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:06 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890" returned: 0 in 0.684s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b14a195-cc88-4319-b81f-1440573c3ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:49:06 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e3701c-5444-4ac5-958f-b0b28015ba37]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:06 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 Jun 01 09:49:06 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:07 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2" returned: 0 in 0.668s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:07 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 Jun 01 09:49:07 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:07 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890" returned: 0 in 0.653s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:07 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890 Jun 01 09:49:07 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:08 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2.82ce6366-0819-421e-a7b0-79ecbe404890" returned: 0 in 0.586s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Lock "cinder-quobyte-82ce6366-0819-421e-a7b0-79ecbe404890" released by "_delete_snapshot" :: held 2.680s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Lock "cinder-quobyte-2b14a195-cc88-4319-b81f-1440573c3ff2" released by "delete_snapshot" :: held 2.702s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:08 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Created reservations ['5032d9d1-6e30-481f-bce4-edd19c340aa5', '2354f7f3-0b21-421f-8cc0-21bc077e9db4', '529556ae-8c5b-4a64-b9f6-98fdbdc5237c', 'db134b04-a20b-4b4c-9bea-5e6b65031c69'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:49:08 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Delete snapshot completed successfully. Jun 01 09:49:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a4896da-6bed-4ba9-b307-c41d464cad95 tempest-TestStampPattern-46570907 None] Lock "cinder-82ce6366-0819-421e-a7b0-79ecbe404890-delete_snapshot" released by "delete_snapshot" :: held 2.822s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Acquiring lock "cinder-2b14a195-cc88-4319-b81f-1440573c3ff2-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Lock "cinder-2b14a195-cc88-4319-b81f-1440573c3ff2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Acquiring lock "cinder-quobyte-2b14a195-cc88-4319-b81f-1440573c3ff2" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Lock "cinder-quobyte-2b14a195-cc88-4319-b81f-1440573c3ff2" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:15 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3614f50b-1241-4f81-a41a-b903fc1b01a3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:16 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 Jun 01 09:49:16 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:16 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2" returned: 0 in 0.694s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:16 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2 Jun 01 09:49:16 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:17 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-2b14a195-cc88-4319-b81f-1440573c3ff2" returned: 0 in 0.591s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Lock "cinder-quobyte-2b14a195-cc88-4319-b81f-1440573c3ff2" released by "delete_volume" :: held 1.339s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:17 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Created reservations ['5d0627ab-da3c-4f95-b69b-5db6ac5ed8e2', '3bd61fe5-155b-4e91-8b7f-73830b1db8e1', '8161d08a-1242-4632-b289-8b66ec1684c2', 'd4d10ec0-1c72-4784-ac3f-712ac3cdb6e0'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:49:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:49:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:49:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:49:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:49:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:49:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:17 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:49:17 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:17 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.586s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:17 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:49:17 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Deleted volume successfully. Jun 01 09:49:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb3065d0-9761-4838-9003-7fd26ac30202 tempest-TestStampPattern-46570907 None] Lock "cinder-2b14a195-cc88-4319-b81f-1440573c3ff2-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Flow 'volume_create_manager' (a2f4ea39-6f5c-4a89-af6d-476c3b6334ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876200bf-f5ff-43c5-88d7-f3afecbb57b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876200bf-f5ff-43c5-88d7-f3afecbb57b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-728745020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc986a0-3a1e-425e-b60a-a7f333ee30c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ab5594ecb54d4bbd8cc9bba33a2528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:49:27Z,use_quota=True,user_id='528a9291b9304c8abb3b5255d5110e89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb07adc-2e32-4a8c-ac53-5770e15de50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb07adc-2e32-4a8c-ac53-5770e15de50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e80bdc9-6231-4488-b2c4-901b8a0bf4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e80bdc9-6231-4488-b2c4-901b8a0bf4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dc986a0-3a1e-425e-b60a-a7f333ee30c5', 'volume_name': 'volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aef1b81-1b8b-4f4c-92a3-bec67ea8b86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aef1b81-1b8b-4f4c-92a3-bec67ea8b86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446b54fd-f350-40c2-b27c-042c4df54f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:27 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Volume 5dc986a0-3a1e-425e-b60a-a7f333ee30c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5', 'volume_size': 1} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-728745020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc986a0-3a1e-425e-b60a-a7f333ee30c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ab5594ecb54d4bbd8cc9bba33a2528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:49:27Z,use_quota=True,user_id='528a9291b9304c8abb3b5255d5110e89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Creating volume 5dc986a0-3a1e-425e-b60a-a7f333ee30c5 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:49:27 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:49:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:27 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 1073741824 Jun 01 09:49:27 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:28 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 1073741824" returned: 0 in 0.752s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:28 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 Jun 01 09:49:28 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:28 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5" returned: 0 in 0.575s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:49:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:49:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446b54fd-f350-40c2-b27c-042c4df54f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbf31c8-9707-4c6f-be5f-d6955bdb70c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Volume volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 (5dc986a0-3a1e-425e-b60a-a7f333ee30c5): created successfully Jun 01 09:49:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbf31c8-9707-4c6f-be5f-d6955bdb70c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Flow 'volume_create_manager' (a2f4ea39-6f5c-4a89-af6d-476c3b6334ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:49:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-279b74a2-c2a2-45e7-860c-6e4f0040021d tempest-VolumeDependencyTests-1492538385 None] Created volume successfully. Jun 01 09:49:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:49:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:49:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] Creating offline snapshot b0c85cdd-e80c-41eb-8c27-86e72e33ac1d of volume 5dc986a0-3a1e-425e-b60a-a7f333ee30c5 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:49:29 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[df109510-876b-4c7a-954a-ce983a2e29b4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:29 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 Jun 01 09:49:29 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:30 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5" returned: 0 in 0.697s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:30 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d 1G Jun 01 09:49:30 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:31 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d 1G" returned: 0 in 0.712s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:31 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d Jun 01 09:49:31 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:31 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d" returned: 0 in 0.623s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:31 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d is being set with open permissions: ugo+rw Jun 01 09:49:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:31 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d Jun 01 09:49:31 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:32 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d" returned: 0 in 0.583s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:32 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.info Jun 01 09:49:32 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:32 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.info" returned: 0 in 0.580s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:32 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.info is being set with open permissions: ugo+rw Jun 01 09:49:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:32 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.info Jun 01 09:49:32 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:33 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.info" returned: 0 in 0.576s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.852s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:49:33 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a26d937a-fcb5-448d-bd3c-c41e2e444f0a tempest-VolumeDependencyTests-1492538385 None] Create snapshot completed successfully Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Flow 'volume_create_manager' (f94003ba-7ebb-4d45-a23a-0a40a88a98cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb176add-52d9-407c-bcba-14d2893be4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb176add-52d9-407c-bcba-14d2893be4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-308332217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5367d6-a04a-47b3-b47b-5359e7f4ab4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ab5594ecb54d4bbd8cc9bba33a2528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b0c85cdd-e80c-41eb-8c27-86e72e33ac1d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:49:34Z,use_quota=True,user_id='528a9291b9304c8abb3b5255d5110e89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932dfe3a-4e02-4860-93cf-38e4023b3e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932dfe3a-4e02-4860-93cf-38e4023b3e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c302524e-c3bf-44e5-a516-8b430e5353e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c302524e-c3bf-44e5-a516-8b430e5353e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5d5367d6-a04a-47b3-b47b-5359e7f4ab4d', 'volume_name': 'volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d', 'volume_size': 1, 'snapshot_id': 'b0c85cdd-e80c-41eb-8c27-86e72e33ac1d'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064c2173-f2d2-4e68-8828-82254bad1c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064c2173-f2d2-4e68-8828-82254bad1c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d70a17c-ee32-4c3f-9235-d79aff0f0974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:34 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Volume 5d5367d6-a04a-47b3-b47b-5359e7f4ab4d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d', 'volume_size': 1, 'snapshot_id': 'b0c85cdd-e80c-41eb-8c27-86e72e33ac1d'} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "cinder-quobyte-b0c85cdd-e80c-41eb-8c27-86e72e33ac1d-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-quobyte-b0c85cdd-e80c-41eb-8c27-86e72e33ac1d-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Creating volume 5d5367d6-a04a-47b3-b47b-5359e7f4ab4d from snapshot b0c85cdd-e80c-41eb-8c27-86e72e33ac1d {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "cinder-quobyte-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-quobyte-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] snapshot: b0c85cdd-e80c-41eb-8c27-86e72e33ac1d, volume: 5d5367d6-a04a-47b3-b47b-5359e7f4ab4d, {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eb7e33-fe96-48d7-9b5a-2c45715efeae]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:34 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d Jun 01 09:49:34 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:34 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d" returned: 0 in 0.686s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 01 09:49:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 01 09:49:35 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[218a8741-84c7-49e9-82a7-5af52c0773b5]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:35 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 Jun 01 09:49:35 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:35 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5" returned: 0 in 0.692s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:35 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Path /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 01 09:49:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:35 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d Jun 01 09:49:35 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:49:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:49:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:49:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:49:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:49:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:49:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:36 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:49:36 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:37 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.007s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:49:40 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d" returned: 0 in 4.439s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:40 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8194d8ee-41a5-4049-9658-6b7fa88dcd90]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:40 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 Jun 01 09:49:40 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:40 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5" returned: 0 in 0.836s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:40 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Image conversion details: src /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5, size 1024.00 MB, duration 4.44 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:49:40 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Converted 1024.00 MB image at 230.66 MB/s Jun 01 09:49:40 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d is being set with open permissions: ugo+rw Jun 01 09:49:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:41 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d Jun 01 09:49:41 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:41 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d" returned: 0 in 0.575s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-quobyte-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d" released by "_copy_volume_from_snapshot" :: held 7.314s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-quobyte-b0c85cdd-e80c-41eb-8c27-86e72e33ac1d-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d" released by "_create_volume_from_snapshot" :: held 7.342s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.356s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d70a17c-ee32-4c3f-9235-d79aff0f0974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d', 'volume_size': 1, 'snapshot_id': 'b0c85cdd-e80c-41eb-8c27-86e72e33ac1d'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99368b4-3fae-4635-b83e-ba92844215f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:41 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Volume volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d (5d5367d6-a04a-47b3-b47b-5359e7f4ab4d): created successfully Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99368b4-3fae-4635-b83e-ba92844215f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Flow 'volume_create_manager' (f94003ba-7ebb-4d45-a23a-0a40a88a98cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:49:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d2d7eec9-d7ab-4d30-bf4f-97fdc39d24b7 tempest-VolumeDependencyTests-1492538385 None] Created volume successfully. Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "cinder-b0c85cdd-e80c-41eb-8c27-86e72e33ac1d-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-b0c85cdd-e80c-41eb-8c27-86e72e33ac1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "cinder-quobyte-5dc986a0-3a1e-425e-b60a-a7f333ee30c5" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-quobyte-5dc986a0-3a1e-425e-b60a-a7f333ee30c5" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "cinder-quobyte-b0c85cdd-e80c-41eb-8c27-86e72e33ac1d" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-quobyte-b0c85cdd-e80c-41eb-8c27-86e72e33ac1d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Deleting offline snapshot b0c85cdd-e80c-41eb-8c27-86e72e33ac1d of volume 5dc986a0-3a1e-425e-b60a-a7f333ee30c5 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] snapshot_file for this snap is: volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8753378f-5df4-4b3b-94bb-66e8d584e0ab]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:41 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d Jun 01 09:49:41 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:42 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d" returned: 0 in 0.679s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:49:42 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[405b7973-1477-400b-a96f-5ab7ad5e5213]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:42 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 Jun 01 09:49:42 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:43 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5" returned: 0 in 0.675s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:43 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d Jun 01 09:49:43 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:43 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d" returned: 0 in 0.659s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:43 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d Jun 01 09:49:43 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:44 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5.b0c85cdd-e80c-41eb-8c27-86e72e33ac1d" returned: 0 in 0.578s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-quobyte-b0c85cdd-e80c-41eb-8c27-86e72e33ac1d" released by "_delete_snapshot" :: held 2.687s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-quobyte-5dc986a0-3a1e-425e-b60a-a7f333ee30c5" released by "delete_snapshot" :: held 2.706s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:44 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Created reservations ['9755b0dc-6b2b-47f1-9ae4-8197073ce76b', '3dd32685-b3b8-4944-a78b-38afb56d9325', '92eaafbb-4263-4ea0-b11d-94b0d6a741c3', '430af446-a413-402f-bf40-4a2cdb562875'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:49:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Delete snapshot completed successfully. Jun 01 09:49:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-59b0829a-4e18-4974-aa44-1b96a6ae215a tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-b0c85cdd-e80c-41eb-8c27-86e72e33ac1d-delete_snapshot" released by "delete_snapshot" :: held 2.821s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "cinder-5dc986a0-3a1e-425e-b60a-a7f333ee30c5-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-5dc986a0-3a1e-425e-b60a-a7f333ee30c5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "cinder-quobyte-5dc986a0-3a1e-425e-b60a-a7f333ee30c5" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-quobyte-5dc986a0-3a1e-425e-b60a-a7f333ee30c5" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:45 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5ba6ef-6ad4-441d-ba5c-9277dbb2e08c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:45 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 Jun 01 09:49:45 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:45 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5" returned: 0 in 0.676s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:45 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5 Jun 01 09:49:45 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:46 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5dc986a0-3a1e-425e-b60a-a7f333ee30c5" returned: 0 in 0.583s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-quobyte-5dc986a0-3a1e-425e-b60a-a7f333ee30c5" released by "delete_volume" :: held 1.310s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:46 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Created reservations ['01718659-ac8f-49b2-9ef4-b4e4aab54c42', '1b0af33b-89de-4fed-9f09-460dc1a6d21f', '5b485a47-b509-4ed0-9ea3-8c40f24fc977', 'fb3e4b64-bc9c-49a9-9b89-1c152d50b308'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:49:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:49:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:49:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:49:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:49:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:49:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:46 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:49:46 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:46 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.567s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:46 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:49:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Deleted volume successfully. Jun 01 09:49:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-18488f64-e43b-4d73-a91b-5b3ae9c014e3 tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-5dc986a0-3a1e-425e-b60a-a7f333ee30c5-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "cinder-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "cinder-quobyte-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:49:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-quobyte-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:49:47 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57a735f-b4a8-44ba-b395-7d7b7c7cd727]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:47 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d Jun 01 09:49:47 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:47 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d" returned: 0 in 0.679s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:47 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d Jun 01 09:49:47 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:48 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d" returned: 0 in 0.566s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-quobyte-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d" released by "delete_volume" :: held 1.284s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:48 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Created reservations ['5400c197-1f79-4f32-8544-f74689994375', '71edfa51-d281-4176-8206-3c271312f820', 'd92ca786-9607-4544-a163-36cef38354ac', '78951970-ccc2-4087-b198-6e8cb399997e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:49:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:49:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:49:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:49:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:49:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:49:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:48 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:49:48 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:49 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.595s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:49 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:49:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Deleted volume successfully. Jun 01 09:49:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-25b4570f-6044-4ad2-adf4-fb0ed85ea7ed tempest-VolumeDependencyTests-1492538385 None] Lock "cinder-5d5367d6-a04a-47b3-b47b-5359e7f4ab4d-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:49:53 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:49:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Flow 'volume_create_manager' (cc057f04-63a6-4827-a65f-54d3732784c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:49:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de70ddc-726f-4137-90bf-0efd61c06bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de70ddc-726f-4137-90bf-0efd61c06bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93f94a1-35c5-4c45-b3a1-69241f34aaee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ce5b66541d4861842da914cbe72fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:49:54Z,use_quota=True,user_id='0cc5c5a6b138449e9bf40f41aa08680b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68ede97-2089-4381-835e-30b402d9c3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68ede97-2089-4381-835e-30b402d9c3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139f0665-343b-48be-bfa8-c5881438f485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:53 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 01 09:49:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139f0665-343b-48be-bfa8-c5881438f485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f93f94a1-35c5-4c45-b3a1-69241f34aaee', 'volume_name': 'volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee', 'volume_size': 1, 'image_id': '9e1ace18-5a1f-45c6-86a2-23ab463f23d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e1ace18-5a1f-45c6-86a2-23ab463f23d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf46d27693743c900a49e7c896dcb410', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01ce5b66541d4861842da914cbe72fda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ede6b9637cbfa874465cae3ab1d74806d788493d8cb1b0b84f9308536dc18ded269ed4954b863c353aa698da79041926a7a6ed7e35f9a27eef6b69b52e853cfe', 'id': '9e1ace18-5a1f-45c6-86a2-23ab463f23d0', 'created_at': datetime.datetime(2026, 6, 1, 7, 49, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 49, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e1ace18-5a1f-45c6-86a2-23ab463f23d0/file', 'properties': {}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e570899-7626-484b-b277-8e3a480e1b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e570899-7626-484b-b277-8e3a480e1b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:49:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05ff6f7-fc97-4620-a692-1b600db4458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:49:54 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Volume f93f94a1-35c5-4c45-b3a1-69241f34aaee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee', 'volume_size': 1, 'image_id': '9e1ace18-5a1f-45c6-86a2-23ab463f23d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e1ace18-5a1f-45c6-86a2-23ab463f23d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf46d27693743c900a49e7c896dcb410', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01ce5b66541d4861842da914cbe72fda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ede6b9637cbfa874465cae3ab1d74806d788493d8cb1b0b84f9308536dc18ded269ed4954b863c353aa698da79041926a7a6ed7e35f9a27eef6b69b52e853cfe', 'id': '9e1ace18-5a1f-45c6-86a2-23ab463f23d0', 'created_at': datetime.datetime(2026, 6, 1, 7, 49, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 49, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e1ace18-5a1f-45c6-86a2-23ab463f23d0/file', 'properties': {}}, 'image_service': } Jun 01 09:49:54 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Trying to clone f93f94a1-35c5-4c45-b3a1-69241f34aaee from image 9e1ace18-5a1f-45c6-86a2-23ab463f23d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9e1ace18-5a1f-45c6-86a2-23ab463f23d0', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 01 09:49:54 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 01 09:49:54 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Image download 0.00 MB at 0.00 MB/s Jun 01 09:49:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[01431bb8-6964-4aab-a129-7bad20dcfeb5]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:54 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD Jun 01 09:49:54 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:54 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD" returned: 0 in 0.668s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:55 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD Jun 01 09:49:55 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:55 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD" returned: 1 in 0.669s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:49:55 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Temporary image 9e1ace18-5a1f-45c6-86a2-23ab463f23d0 is fetched for user 0cc5c5a6b138449e9bf40f41aa08680b. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 01 09:49:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aab963c-aebb-4f3b-94d0-f579fb67d48e]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:55 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD Jun 01 09:49:55 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:56 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD" returned: 0 in 0.645s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:56 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD Jun 01 09:49:56 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:56 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD" returned: 1 in 0.648s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93f94a1-35c5-4c45-b3a1-69241f34aaee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ce5b66541d4861842da914cbe72fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:49:54Z,use_quota=True,user_id='0cc5c5a6b138449e9bf40f41aa08680b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Creating volume f93f94a1-35c5-4c45-b3a1-69241f34aaee {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:49:56 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:49:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:57 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee 1073741824 Jun 01 09:49:57 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:57 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee 1073741824" returned: 0 in 0.728s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:57 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=46,cinder:INSERT=13,cinder:UPDATE=48,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:49:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:57 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee Jun 01 09:49:57 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:58 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee" returned: 0 in 0.565s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:49:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:49:58 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Attempting download of 9e1ace18-5a1f-45c6-86a2-23ab463f23d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/9e1ace18-5a1f-45c6-86a2-23ab463f23d0', 'metadata': {}}])) to volume f93f94a1-35c5-4c45-b3a1-69241f34aaee. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 01 09:49:58 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d629721f-9888-482e-aa1a-e368d5ce3186]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_9wvrzjg7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:58 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_9wvrzjg7 Jun 01 09:49:58 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:59 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_9wvrzjg7" returned: 0 in 0.646s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_9wvrzjg7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:59 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_9wvrzjg7 Jun 01 09:49:59 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:49:59 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Jun 01 09:49:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_9wvrzjg7" returned: 1 in 0.656s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:49:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_9wvrzjg7' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:49:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[21de0660-6387-46db-b432-ae43d3061323]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:49:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:49:59 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD Jun 01 09:49:59 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:00 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD" returned: 0 in 0.663s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:00 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD Jun 01 09:50:00 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:01 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD" returned: 1 in 0.655s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:50:01 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] 9e1ace18-5a1f-45c6-86a2-23ab463f23d0 was raw, converting to raw {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 01 09:50:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:01 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee Jun 01 09:50:01 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:01 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee" returned: 0 in 0.652s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:01 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9e1ace18-5a1f-45c6-86a2-23ab463f23d0_r1_bz3lpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:50:01 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Converted 0.00 MB image at 0.00 MB/s Jun 01 09:50:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:01 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee 1G Jun 01 09:50:01 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:02 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee 1G" returned: 0 in 0.614s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:02 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[657a56ea-0807-4647-9be8-a5df40fbe2a6]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:02 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee Jun 01 09:50:02 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:02 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee" returned: 0 in 0.675s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:03 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee Jun 01 09:50:03 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:03 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee" returned: 1 in 0.666s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:50:03 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Downloaded image 9e1ace18-5a1f-45c6-86a2-23ab463f23d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/9e1ace18-5a1f-45c6-86a2-23ab463f23d0', 'metadata': {}}])) to volume f93f94a1-35c5-4c45-b3a1-69241f34aaee successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 01 09:50:03 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Temporary image 9e1ace18-5a1f-45c6-86a2-23ab463f23d0 for user 0cc5c5a6b138449e9bf40f41aa08680b is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 01 09:50:03 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Marking volume f93f94a1-35c5-4c45-b3a1-69241f34aaee as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 01 09:50:03 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=56,cinder:SELECT=38,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:50:03 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Copying metadata from image 9e1ace18-5a1f-45c6-86a2-23ab463f23d0 to f93f94a1-35c5-4c45-b3a1-69241f34aaee. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 01 09:50:03 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Creating volume glance metadata for volume f93f94a1-35c5-4c45-b3a1-69241f34aaee backed by image 9e1ace18-5a1f-45c6-86a2-23ab463f23d0 with: {'image_id': '9e1ace18-5a1f-45c6-86a2-23ab463f23d0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cf46d27693743c900a49e7c896dcb410', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 01 09:50:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05ff6f7-fc97-4620-a692-1b600db4458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee', 'volume_size': 1, 'image_id': '9e1ace18-5a1f-45c6-86a2-23ab463f23d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e1ace18-5a1f-45c6-86a2-23ab463f23d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf46d27693743c900a49e7c896dcb410', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01ce5b66541d4861842da914cbe72fda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ede6b9637cbfa874465cae3ab1d74806d788493d8cb1b0b84f9308536dc18ded269ed4954b863c353aa698da79041926a7a6ed7e35f9a27eef6b69b52e853cfe', 'id': '9e1ace18-5a1f-45c6-86a2-23ab463f23d0', 'created_at': datetime.datetime(2026, 6, 1, 7, 49, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 49, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e1ace18-5a1f-45c6-86a2-23ab463f23d0/file', 'properties': {}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7206cf0e-4f18-4f4c-856d-b3b63f2c1682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:03 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Volume volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee (f93f94a1-35c5-4c45-b3a1-69241f34aaee): created successfully Jun 01 09:50:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7206cf0e-4f18-4f4c-856d-b3b63f2c1682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Flow 'volume_create_manager' (cc057f04-63a6-4827-a65f-54d3732784c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ca0fa49d-097d-4dbb-8a66-6a9c765ad732 tempest-VolumeImageDependencyTests-1762466928 None] Created volume successfully. Jun 01 09:50:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Acquiring lock "cinder-f93f94a1-35c5-4c45-b3a1-69241f34aaee-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Lock "cinder-f93f94a1-35c5-4c45-b3a1-69241f34aaee-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Acquiring lock "cinder-quobyte-f93f94a1-35c5-4c45-b3a1-69241f34aaee" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Lock "cinder-quobyte-f93f94a1-35c5-4c45-b3a1-69241f34aaee" acquired by "delete_volume" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd275a6-0af7-4375-b4a9-15cbb90a547e]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:04 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee Jun 01 09:50:04 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:05 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee" returned: 0 in 0.679s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:05 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee Jun 01 09:50:05 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:05 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee" returned: 1 in 0.684s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:50:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:05 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee Jun 01 09:50:05 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:06 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f93f94a1-35c5-4c45-b3a1-69241f34aaee" returned: 0 in 0.578s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Lock "cinder-quobyte-f93f94a1-35c5-4c45-b3a1-69241f34aaee" released by "delete_volume" :: held 1.999s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:06 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Created reservations ['a57bc4c2-83c8-425f-937d-1bd705d5d4da', '84c3f248-ad87-4c48-92a4-ecc37f34f812', '13c76e9a-dc8c-49cf-af04-7f5e24708811', '1ae121e3-7236-4c3a-ac66-0c8f3055f70f'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:50:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:06 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:50:06 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:07 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.621s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:07 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:50:07 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Deleted volume successfully. Jun 01 09:50:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a03269f0-a8da-40c3-bb72-53cf7a89b19d tempest-VolumeImageDependencyTests-1762466928 None] Lock "cinder-f93f94a1-35c5-4c45-b3a1-69241f34aaee-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Flow 'volume_create_manager' (786c2d71-c672-48c6-b54e-82181a8c4b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2be9fb7-ce53-4b00-857b-52145c13d473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2be9fb7-ce53-4b00-857b-52145c13d473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-438326857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7916133b-1fbb-445d-8f70-398f529848e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e028d206ec148baa4a6472e8743d0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:19Z,use_quota=True,user_id='e25978d8c9f74128aaf722c6aea68a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0b4cc8-c6f4-4b5e-b37a-c0af29b95b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0b4cc8-c6f4-4b5e-b37a-c0af29b95b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be65dd91-98c8-4ce7-ab92-bc1e18372754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be65dd91-98c8-4ce7-ab92-bc1e18372754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7916133b-1fbb-445d-8f70-398f529848e6', 'volume_name': 'volume-7916133b-1fbb-445d-8f70-398f529848e6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c827b2c1-1618-4133-9697-b3703d227b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c827b2c1-1618-4133-9697-b3703d227b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbba2632-6983-460d-a66f-87761803d251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:18 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Volume 7916133b-1fbb-445d-8f70-398f529848e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7916133b-1fbb-445d-8f70-398f529848e6', 'volume_size': 1} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-438326857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7916133b-1fbb-445d-8f70-398f529848e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e028d206ec148baa4a6472e8743d0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:19Z,use_quota=True,user_id='e25978d8c9f74128aaf722c6aea68a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Creating volume 7916133b-1fbb-445d-8f70-398f529848e6 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:18 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7916133b-1fbb-445d-8f70-398f529848e6 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:18 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7916133b-1fbb-445d-8f70-398f529848e6 1073741824 Jun 01 09:50:18 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Flow 'volume_create_manager' (2199bd1e-c5f3-4200-81c4-b11d9ad330a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e1c893-ef76-4490-8676-fa13e2621a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e1c893-ef76-4490-8676-fa13e2621a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be28f1d-b2b1-43ab-a040-b0084c2bc769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c93f75eed894d07af2ff65541e9b125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:19Z,use_quota=True,user_id='f717f6b9970e414598d22bb233f3df93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e050bc35-4b37-4db6-9a30-b7f620ce01f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e050bc35-4b37-4db6-9a30-b7f620ce01f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9e287b-181b-4743-9d66-7ba7b9aea7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9e287b-181b-4743-9d66-7ba7b9aea7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6be28f1d-b2b1-43ab-a040-b0084c2bc769', 'volume_name': 'volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5b6d15-d521-4613-ab83-63a58e7cfdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5b6d15-d521-4613-ab83-63a58e7cfdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5738d20-0588-4544-ae62-5ed5095b3822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:18 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Volume 6be28f1d-b2b1-43ab-a040-b0084c2bc769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769', 'volume_size': 1} Jun 01 09:50:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Flow 'volume_create_manager' (9cd070f4-8b51-4888-ad00-c6c5212cd2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c14845e-1fd4-4ecc-ad85-2c557547e985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c14845e-1fd4-4ecc-ad85-2c557547e985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-155240892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a24d242-774b-447e-a389-04305f2cc8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e028d206ec148baa4a6472e8743d0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:19Z,use_quota=True,user_id='e25978d8c9f74128aaf722c6aea68a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df9e405-afcd-46e7-9fee-3ee73d51ec42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df9e405-afcd-46e7-9fee-3ee73d51ec42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7942e3-6e87-425e-ba4b-a6ef45fd864a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7942e3-6e87-425e-ba4b-a6ef45fd864a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a24d242-774b-447e-a389-04305f2cc8c3', 'volume_name': 'volume-4a24d242-774b-447e-a389-04305f2cc8c3', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27046e54-17b9-40fd-8a3d-fe249cd142da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27046e54-17b9-40fd-8a3d-fe249cd142da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d433a9c-c00f-4748-9468-b354dd2b7e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Volume 4a24d242-774b-447e-a389-04305f2cc8c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a24d242-774b-447e-a389-04305f2cc8c3', 'volume_size': 1} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Flow 'volume_create_manager' (4a93dd18-c7bd-46b6-a46d-d93336bb73a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9609ffc0-9d4f-4810-97fb-fd8a64e7a951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9609ffc0-9d4f-4810-97fb-fd8a64e7a951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1140470514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28f9cd2-cea8-4415-a909-65f9792c23f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e028d206ec148baa4a6472e8743d0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:19Z,use_quota=True,user_id='e25978d8c9f74128aaf722c6aea68a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232bf0d0-6740-4f12-a37b-dad006394861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232bf0d0-6740-4f12-a37b-dad006394861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b92936-66a9-41d1-b2fa-e23a9aa60d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b92936-66a9-41d1-b2fa-e23a9aa60d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28f9cd2-cea8-4415-a909-65f9792c23f2', 'volume_name': 'volume-d28f9cd2-cea8-4415-a909-65f9792c23f2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38da2957-039c-49a1-af83-d6fee209a8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38da2957-039c-49a1-af83-d6fee209a8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a10093-90c1-4b67-a81c-0661e58fdd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Volume d28f9cd2-cea8-4415-a909-65f9792c23f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28f9cd2-cea8-4415-a909-65f9792c23f2', 'volume_size': 1} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Flow 'volume_create_manager' (71bab42c-4ec9-4d93-a670-7ac910a8bbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56738539-14a4-4644-bfd6-14a488be1cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56738539-14a4-4644-bfd6-14a488be1cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-425701398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d57bf5-feb1-47e2-88f3-43827df612bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa30abe17f964004a5f5221d361d6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:19Z,use_quota=True,user_id='76e75f5ad6d442aeb21a541eb47fea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d61d85-f7d6-4579-a5bb-a4d0df8af477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d61d85-f7d6-4579-a5bb-a4d0df8af477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dcd611a-7ba9-4f28-ae04-8e0b40ac8762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dcd611a-7ba9-4f28-ae04-8e0b40ac8762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d57bf5-feb1-47e2-88f3-43827df612bb', 'volume_name': 'volume-79d57bf5-feb1-47e2-88f3-43827df612bb', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b33a9d-a507-4cc4-89e4-f80a352b3f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b33a9d-a507-4cc4-89e4-f80a352b3f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229796ec-281d-41dd-b7a8-a6c049518303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume 79d57bf5-feb1-47e2-88f3-43827df612bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d57bf5-feb1-47e2-88f3-43827df612bb', 'volume_size': 1} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Flow 'volume_create_manager' (9cb52f51-3f10-411c-9a95-399381d6942f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69af180-7df7-4e0b-8ed1-7c2c8fddb669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69af180-7df7-4e0b-8ed1-7c2c8fddb669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1988853629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=285c8775-0d37-4616-a9af-2e50d43fb049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e028d206ec148baa4a6472e8743d0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:20Z,use_quota=True,user_id='e25978d8c9f74128aaf722c6aea68a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a7320e-aafa-46c3-a192-6fd04ca8486e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a7320e-aafa-46c3-a192-6fd04ca8486e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34093e0b-550f-4b40-a199-07a47412c039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34093e0b-550f-4b40-a199-07a47412c039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '285c8775-0d37-4616-a9af-2e50d43fb049', 'volume_name': 'volume-285c8775-0d37-4616-a9af-2e50d43fb049', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f8e0e3-c650-4c15-86f7-949a6594a073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f8e0e3-c650-4c15-86f7-949a6594a073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (679921cd-0432-4d13-ac01-a0f56a1c7346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:19 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Volume 285c8775-0d37-4616-a9af-2e50d43fb049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-285c8775-0d37-4616-a9af-2e50d43fb049', 'volume_size': 1} Jun 01 09:50:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:20 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7916133b-1fbb-445d-8f70-398f529848e6 1073741824" returned: 0 in 1.328s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7916133b-1fbb-445d-8f70-398f529848e6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:20 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7916133b-1fbb-445d-8f70-398f529848e6 Jun 01 09:50:20 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Flow 'volume_create_manager' (a2e738ac-d73c-4f70-8d1e-d73d4aabaefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc2d360-e3b0-4b1e-a3d5-eda329db5019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc2d360-e3b0-4b1e-a3d5-eda329db5019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-203426518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=473e0eed-605a-4d06-a8f8-0715c5666a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e028d206ec148baa4a6472e8743d0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:20Z,use_quota=True,user_id='e25978d8c9f74128aaf722c6aea68a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61739416-6d4a-4167-9db3-8ad54542f4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61739416-6d4a-4167-9db3-8ad54542f4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5135983d-8fc4-4e4d-953f-af1d90f2dbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5135983d-8fc4-4e4d-953f-af1d90f2dbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '473e0eed-605a-4d06-a8f8-0715c5666a0e', 'volume_name': 'volume-473e0eed-605a-4d06-a8f8-0715c5666a0e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34154078-3b87-43e7-86c1-af4c55fc862b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34154078-3b87-43e7-86c1-af4c55fc862b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a2d8ba-7a35-47cf-bf35-a277b4138cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:20 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Volume 473e0eed-605a-4d06-a8f8-0715c5666a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-473e0eed-605a-4d06-a8f8-0715c5666a0e', 'volume_size': 1} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:20 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7916133b-1fbb-445d-8f70-398f529848e6" returned: 0 in 0.615s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.789s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be28f1d-b2b1-43ab-a040-b0084c2bc769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c93f75eed894d07af2ff65541e9b125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:19Z,use_quota=True,user_id='f717f6b9970e414598d22bb233f3df93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Creating volume 6be28f1d-b2b1-43ab-a040-b0084c2bc769 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:20 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:20 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769 1073741824 Jun 01 09:50:20 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbba2632-6983-460d-a66f-87761803d251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7916133b-1fbb-445d-8f70-398f529848e6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d76df7-b7fe-4fd1-a023-de04d1a02297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:20 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Volume volume-7916133b-1fbb-445d-8f70-398f529848e6 (7916133b-1fbb-445d-8f70-398f529848e6): created successfully Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d76df7-b7fe-4fd1-a023-de04d1a02297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Flow 'volume_create_manager' (786c2d71-c672-48c6-b54e-82181a8c4b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5fac1a40-0468-4ab6-b9f6-c642257d68ff tempest-CreateVolumesFromImageTest-2113971225 None] Created volume successfully. Jun 01 09:50:21 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769 1073741824" returned: 0 in 0.765s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:21 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769 Jun 01 09:50:21 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:22 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769" returned: 0 in 0.627s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.987s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-155240892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a24d242-774b-447e-a389-04305f2cc8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e028d206ec148baa4a6472e8743d0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:19Z,use_quota=True,user_id='e25978d8c9f74128aaf722c6aea68a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Creating volume 4a24d242-774b-447e-a389-04305f2cc8c3 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:22 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4a24d242-774b-447e-a389-04305f2cc8c3 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5738d20-0588-4544-ae62-5ed5095b3822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbaec85a-18d2-41af-90d5-4cfe4cded2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:22 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4a24d242-774b-447e-a389-04305f2cc8c3 1073741824 Jun 01 09:50:22 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:22 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Volume volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769 (6be28f1d-b2b1-43ab-a040-b0084c2bc769): created successfully Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbaec85a-18d2-41af-90d5-4cfe4cded2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Flow 'volume_create_manager' (2199bd1e-c5f3-4200-81c4-b11d9ad330a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-615e6831-f9eb-4022-a1d7-ed89e03c9969 tempest-CinderUnicodeTest-1373426053 None] Created volume successfully. Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Flow 'volume_create_manager' (bb72ff9b-bf81-4bce-912a-6bbdac1c40f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f779ac9d-dbb1-412e-9282-aa56b80877c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f779ac9d-dbb1-412e-9282-aa56b80877c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341aeb0d-f70a-4e57-aab4-6f7256360547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f0d3e45f234bf9afb6576a2c70e719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:22Z,use_quota=True,user_id='9d782e36c73b4389a01c0f103bb6113c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a83cb515-6318-4fc9-af8e-2f430f2c4b2e),volume_type_id=a83cb515-6318-4fc9-af8e-2f430f2c4b2e)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a8e483-125b-4cf7-8729-9d029dbd7d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a8e483-125b-4cf7-8729-9d029dbd7d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd15effc-045c-49b8-9c9b-9d599dc5f6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd15effc-045c-49b8-9c9b-9d599dc5f6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '341aeb0d-f70a-4e57-aab4-6f7256360547', 'volume_name': 'volume-341aeb0d-f70a-4e57-aab4-6f7256360547', 'volume_size': 1, 'image_id': '86e77745-271a-4791-bec1-f6fdfebd41dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86e77745-271a-4791-bec1-f6fdfebd41dc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a6d79ff8a229f0ec54a0d825f461979', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37f0d3e45f234bf9afb6576a2c70e719', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eaa672605708d81a0891821a4104a3778df204387c182753b379943b4de52c72bc07b11056397f948c9b5047ca358fa1756443a3a237e7ee2dd23c13f4790da4', 'id': '86e77745-271a-4791-bec1-f6fdfebd41dc', 'created_at': datetime.datetime(2026, 6, 1, 7, 50, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 50, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86e77745-271a-4791-bec1-f6fdfebd41dc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6872e76-30f5-4433-8773-b9c4bd7e2f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6872e76-30f5-4433-8773-b9c4bd7e2f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605eb1b5-e6e5-4e64-ba84-ae4cad444c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:22 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Volume 341aeb0d-f70a-4e57-aab4-6f7256360547: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-341aeb0d-f70a-4e57-aab4-6f7256360547', 'volume_size': 1, 'image_id': '86e77745-271a-4791-bec1-f6fdfebd41dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86e77745-271a-4791-bec1-f6fdfebd41dc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a6d79ff8a229f0ec54a0d825f461979', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37f0d3e45f234bf9afb6576a2c70e719', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eaa672605708d81a0891821a4104a3778df204387c182753b379943b4de52c72bc07b11056397f948c9b5047ca358fa1756443a3a237e7ee2dd23c13f4790da4', 'id': '86e77745-271a-4791-bec1-f6fdfebd41dc', 'created_at': datetime.datetime(2026, 6, 1, 7, 50, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 50, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86e77745-271a-4791-bec1-f6fdfebd41dc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Trying to clone 341aeb0d-f70a-4e57-aab4-6f7256360547 from image 86e77745-271a-4791-bec1-f6fdfebd41dc at location (None, [{'url': 'file:///opt/stack/data/glance/images/86e77745-271a-4791-bec1-f6fdfebd41dc', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 01 09:50:22 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Image download 0.00 MB at 0.00 MB/s Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b79b4c-3d65-44cf-94d8-adaf9d6ff867]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:23 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD Jun 01 09:50:23 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:23 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4a24d242-774b-447e-a389-04305f2cc8c3 1073741824" returned: 0 in 0.837s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4a24d242-774b-447e-a389-04305f2cc8c3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:23 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4a24d242-774b-447e-a389-04305f2cc8c3 Jun 01 09:50:23 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:23 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:23 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4a24d242-774b-447e-a389-04305f2cc8c3" returned: 0 in 0.644s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.121s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1140470514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28f9cd2-cea8-4415-a909-65f9792c23f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e028d206ec148baa4a6472e8743d0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:19Z,use_quota=True,user_id='e25978d8c9f74128aaf722c6aea68a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Creating volume d28f9cd2-cea8-4415-a909-65f9792c23f2 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:23 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d28f9cd2-cea8-4415-a909-65f9792c23f2 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:23 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d28f9cd2-cea8-4415-a909-65f9792c23f2 1073741824 Jun 01 09:50:23 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d433a9c-c00f-4748-9468-b354dd2b7e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a24d242-774b-447e-a389-04305f2cc8c3', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e05034d-46c5-4055-a62b-bd1fd4cdcc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:23 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD Jun 01 09:50:23 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Flow 'volume_create_manager' (07e43fca-ef0f-4eca-996d-c47b941201c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf33f146-6986-415c-a261-4c7a68f5772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:23 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Volume volume-4a24d242-774b-447e-a389-04305f2cc8c3 (4a24d242-774b-447e-a389-04305f2cc8c3): created successfully Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e05034d-46c5-4055-a62b-bd1fd4cdcc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Flow 'volume_create_manager' (9cd070f4-8b51-4888-ad00-c6c5212cd2b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf33f146-6986-415c-a261-4c7a68f5772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1918737637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5efa66-fb40-46bb-92d3-72b44353fd82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c93f75eed894d07af2ff65541e9b125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:24Z,use_quota=True,user_id='f717f6b9970e414598d22bb233f3df93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb39c50c-2085-4fb7-b0e3-f64ef45cb7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb39c50c-2085-4fb7-b0e3-f64ef45cb7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31024917-5e80-4688-824a-b04c31cedec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31024917-5e80-4688-824a-b04c31cedec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5efa66-fb40-46bb-92d3-72b44353fd82', 'volume_name': 'volume-6f5efa66-fb40-46bb-92d3-72b44353fd82', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b120e55-d0f6-4c7d-9757-f420d83d882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b120e55-d0f6-4c7d-9757-f420d83d882d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5099e13d-69c6-4901-83f9-94b0b9d2fcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:23 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Volume 6f5efa66-fb40-46bb-92d3-72b44353fd82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5efa66-fb40-46bb-92d3-72b44353fd82', 'volume_size': 1} Jun 01 09:50:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ac335aa2-e02f-4f7f-a5f6-f38345d5f324 tempest-CreateVolumesFromImageTest-2113971225 None] Created volume successfully. Jun 01 09:50:24 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD" returned: 1 in 0.721s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:50:24 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Temporary image 86e77745-271a-4791-bec1-f6fdfebd41dc is fetched for user 9d782e36c73b4389a01c0f103bb6113c. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 01 09:50:24 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b30532-4fec-4bdf-b5d2-d266ba750934]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:24 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD Jun 01 09:50:24 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:24 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d28f9cd2-cea8-4415-a909-65f9792c23f2 1073741824" returned: 0 in 0.848s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d28f9cd2-cea8-4415-a909-65f9792c23f2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:24 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d28f9cd2-cea8-4415-a909-65f9792c23f2 Jun 01 09:50:24 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:25 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD" returned: 0 in 0.692s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:25 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d28f9cd2-cea8-4415-a909-65f9792c23f2" returned: 0 in 0.590s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.491s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-425701398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d57bf5-feb1-47e2-88f3-43827df612bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa30abe17f964004a5f5221d361d6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:19Z,use_quota=True,user_id='76e75f5ad6d442aeb21a541eb47fea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Creating volume 79d57bf5-feb1-47e2-88f3-43827df612bb {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:25 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:25 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD Jun 01 09:50:25 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a10093-90c1-4b67-a81c-0661e58fdd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28f9cd2-cea8-4415-a909-65f9792c23f2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:25 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb 1073741824 Jun 01 09:50:25 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d365bda-eaf8-425e-a3a9-3c236c01db0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:25 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Volume volume-d28f9cd2-cea8-4415-a909-65f9792c23f2 (d28f9cd2-cea8-4415-a909-65f9792c23f2): created successfully Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d365bda-eaf8-425e-a3a9-3c236c01db0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Flow 'volume_create_manager' (4a93dd18-c7bd-46b6-a46d-d93336bb73a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5856461a-f13c-4f99-b3b4-a80558e482b1 tempest-CreateVolumesFromImageTest-2113971225 None] Created volume successfully. Jun 01 09:50:25 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD" returned: 1 in 0.673s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:50:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:26 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb 1073741824" returned: 0 in 0.817s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:26 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb Jun 01 09:50:26 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:26 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb" returned: 0 in 0.563s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.718s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1988853629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=285c8775-0d37-4616-a9af-2e50d43fb049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e028d206ec148baa4a6472e8743d0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:20Z,use_quota=True,user_id='e25978d8c9f74128aaf722c6aea68a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Creating volume 285c8775-0d37-4616-a9af-2e50d43fb049 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:26 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-285c8775-0d37-4616-a9af-2e50d43fb049 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:26 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-285c8775-0d37-4616-a9af-2e50d43fb049 1073741824 Jun 01 09:50:26 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229796ec-281d-41dd-b7a8-a6c049518303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d57bf5-feb1-47e2-88f3-43827df612bb', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a4d17f-4353-4665-87a0-f7bf801ac357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:26 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume volume-79d57bf5-feb1-47e2-88f3-43827df612bb (79d57bf5-feb1-47e2-88f3-43827df612bb): created successfully Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a4d17f-4353-4665-87a0-f7bf801ac357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Flow 'volume_create_manager' (71bab42c-4ec9-4d93-a670-7ac910a8bbd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:26 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-29c21454-daeb-4c1a-a674-532d5b7cd686 tempest-CreateVolumesFromSnapshotTest-687761034 None] Created volume successfully. Jun 01 09:50:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:27 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-285c8775-0d37-4616-a9af-2e50d43fb049 1073741824" returned: 0 in 0.748s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-285c8775-0d37-4616-a9af-2e50d43fb049 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:27 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-285c8775-0d37-4616-a9af-2e50d43fb049 Jun 01 09:50:27 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:28 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-285c8775-0d37-4616-a9af-2e50d43fb049" returned: 0 in 0.574s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.733s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-203426518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=473e0eed-605a-4d06-a8f8-0715c5666a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e028d206ec148baa4a6472e8743d0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:20Z,use_quota=True,user_id='e25978d8c9f74128aaf722c6aea68a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Creating volume 473e0eed-605a-4d06-a8f8-0715c5666a0e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:28 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-473e0eed-605a-4d06-a8f8-0715c5666a0e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:28 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-473e0eed-605a-4d06-a8f8-0715c5666a0e 1073741824 Jun 01 09:50:28 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (679921cd-0432-4d13-ac01-a0f56a1c7346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-285c8775-0d37-4616-a9af-2e50d43fb049', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7431f3aa-9ce5-441b-96df-1b0b6528bd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Volume volume-285c8775-0d37-4616-a9af-2e50d43fb049 (285c8775-0d37-4616-a9af-2e50d43fb049): created successfully Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7431f3aa-9ce5-441b-96df-1b0b6528bd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Flow 'volume_create_manager' (9cb52f51-3f10-411c-9a95-399381d6942f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-71e3f461-74cf-4cfd-b8d2-dcca2ffb5ea9 tempest-CreateVolumesFromImageTest-2113971225 None] Created volume successfully. Jun 01 09:50:28 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-473e0eed-605a-4d06-a8f8-0715c5666a0e 1073741824" returned: 0 in 0.735s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-473e0eed-605a-4d06-a8f8-0715c5666a0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:28 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-473e0eed-605a-4d06-a8f8-0715c5666a0e Jun 01 09:50:28 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:29 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-473e0eed-605a-4d06-a8f8-0715c5666a0e" returned: 0 in 0.568s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.496s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1918737637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5efa66-fb40-46bb-92d3-72b44353fd82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c93f75eed894d07af2ff65541e9b125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:24Z,use_quota=True,user_id='f717f6b9970e414598d22bb233f3df93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Creating volume 6f5efa66-fb40-46bb-92d3-72b44353fd82 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:29 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a2d8ba-7a35-47cf-bf35-a277b4138cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-473e0eed-605a-4d06-a8f8-0715c5666a0e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:29 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 1073741824 Jun 01 09:50:29 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17055e36-fb4a-4ac0-b83d-fab5433340af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:29 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Volume volume-473e0eed-605a-4d06-a8f8-0715c5666a0e (473e0eed-605a-4d06-a8f8-0715c5666a0e): created successfully Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17055e36-fb4a-4ac0-b83d-fab5433340af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Flow 'volume_create_manager' (a2e738ac-d73c-4f70-8d1e-d73d4aabaefb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d7e4ae11-84ab-4fe1-a0dd-c3d237e00e19 tempest-CreateVolumesFromImageTest-2113971225 None] Created volume successfully. Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "cinder-473e0eed-605a-4d06-a8f8-0715c5666a0e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-473e0eed-605a-4d06-a8f8-0715c5666a0e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "cinder-quobyte-473e0eed-605a-4d06-a8f8-0715c5666a0e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-quobyte-473e0eed-605a-4d06-a8f8-0715c5666a0e" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c06c1f-8c3a-4ab3-8be8-a6bcc4248e06]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-473e0eed-605a-4d06-a8f8-0715c5666a0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:30 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 1073741824" returned: 0 in 0.791s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:30 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 Jun 01 09:50:30 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:30 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-473e0eed-605a-4d06-a8f8-0715c5666a0e Jun 01 09:50:30 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:30 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82" returned: 0 in 0.630s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.049s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341aeb0d-f70a-4e57-aab4-6f7256360547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f0d3e45f234bf9afb6576a2c70e719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:22Z,use_quota=True,user_id='9d782e36c73b4389a01c0f103bb6113c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a83cb515-6318-4fc9-af8e-2f430f2c4b2e),volume_type_id=a83cb515-6318-4fc9-af8e-2f430f2c4b2e)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Creating volume 341aeb0d-f70a-4e57-aab4-6f7256360547 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:30 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:30 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-473e0eed-605a-4d06-a8f8-0715c5666a0e" returned: 0 in 0.725s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-473e0eed-605a-4d06-a8f8-0715c5666a0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:30 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 1073741824 Jun 01 09:50:30 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5099e13d-69c6-4901-83f9-94b0b9d2fcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5efa66-fb40-46bb-92d3-72b44353fd82', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:30 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-473e0eed-605a-4d06-a8f8-0715c5666a0e Jun 01 09:50:30 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678b0373-a576-468e-963b-70d7c481a67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:30 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Volume volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 (6f5efa66-fb40-46bb-92d3-72b44353fd82): created successfully Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678b0373-a576-468e-963b-70d7c481a67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Flow 'volume_create_manager' (07e43fca-ef0f-4eca-996d-c47b941201c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d3c30b8c-e5c9-49d6-955b-f95ab1b73989 tempest-CinderUnicodeTest-1373426053 None] Created volume successfully. Jun 01 09:50:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:31 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-473e0eed-605a-4d06-a8f8-0715c5666a0e" returned: 0 in 0.702s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-quobyte-473e0eed-605a-4d06-a8f8-0715c5666a0e" released by "delete_volume" :: held 1.469s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:31 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Created reservations ['fdb7c98b-3044-40fe-8878-c0ed152b3f0b', 'e1bddc00-51b6-4490-bc15-1b80dee4c824', '251ac955-5913-4279-8ff0-3be728909231', 'c108df74-a1ff-43df-9fef-c0bf1e8bc5f9'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:50:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:31 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:50:31 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:31 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 1073741824" returned: 0 in 0.927s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:31 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 Jun 01 09:50:31 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:32 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.590s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:50:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Deleted volume successfully. Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "cinder-285c8775-0d37-4616-a9af-2e50d43fb049-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-285c8775-0d37-4616-a9af-2e50d43fb049-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7be4549f-8aa1-4f96-b9f7-36024c5a786a tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-473e0eed-605a-4d06-a8f8-0715c5666a0e-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "cinder-quobyte-285c8775-0d37-4616-a9af-2e50d43fb049" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-quobyte-285c8775-0d37-4616-a9af-2e50d43fb049" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:32 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547" returned: 0 in 0.613s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[385817ab-26a3-4722-b404-057a36de542f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.237s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-285c8775-0d37-4616-a9af-2e50d43fb049 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] Creating offline snapshot 1fbcb970-d3b9-467c-9ffe-8a70530bbeab of volume 79d57bf5-feb1-47e2-88f3-43827df612bb {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Attempting download of 86e77745-271a-4791-bec1-f6fdfebd41dc ((None, [{'url': 'file:///opt/stack/data/glance/images/86e77745-271a-4791-bec1-f6fdfebd41dc', 'metadata': {}}])) to volume 341aeb0d-f70a-4e57-aab4-6f7256360547. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f5f8cb-94e8-4578-aa04-3024f7a72dc6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f54672-aa1b-4e71-98ab-c3f800243691]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86e77745-271a-4791-bec1-f6fdfebd41dc_3fkfzm1n {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:32 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-285c8775-0d37-4616-a9af-2e50d43fb049 Jun 01 09:50:32 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:32 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb Jun 01 09:50:32 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:32 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86e77745-271a-4791-bec1-f6fdfebd41dc_3fkfzm1n Jun 01 09:50:32 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:33 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-285c8775-0d37-4616-a9af-2e50d43fb049" returned: 0 in 0.762s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-285c8775-0d37-4616-a9af-2e50d43fb049 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:33 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-285c8775-0d37-4616-a9af-2e50d43fb049 Jun 01 09:50:33 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:33 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb" returned: 0 in 0.745s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:33 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86e77745-271a-4791-bec1-f6fdfebd41dc_3fkfzm1n" returned: 0 in 0.729s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86e77745-271a-4791-bec1-f6fdfebd41dc_3fkfzm1n {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:33 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab 1G Jun 01 09:50:33 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:33 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86e77745-271a-4791-bec1-f6fdfebd41dc_3fkfzm1n Jun 01 09:50:33 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:33 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-285c8775-0d37-4616-a9af-2e50d43fb049" returned: 0 in 0.623s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-quobyte-285c8775-0d37-4616-a9af-2e50d43fb049" released by "delete_volume" :: held 1.429s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Created reservations ['6e48f1d1-61ba-4c50-b627-76709b57bfa9', '8483a511-4865-4490-9028-8d38e37e9d6f', 'aa13c284-d5c6-47bb-b5e0-9d928f303c9a', '2dc67373-a65f-4a5b-bdc2-7bdca4571d93'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:33 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:50:33 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:33 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86e77745-271a-4791-bec1-f6fdfebd41dc_3fkfzm1n" returned: 1 in 0.728s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86e77745-271a-4791-bec1-f6fdfebd41dc_3fkfzm1n' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c22e3d-48cc-4011-abfc-82e731be05da]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:34 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab 1G" returned: 0 in 0.782s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d57bf5-feb1-47e2-88f3-43827df612bb -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:34 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d57bf5-feb1-47e2-88f3-43827df612bb -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab Jun 01 09:50:34 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:34 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD Jun 01 09:50:34 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "cinder-d28f9cd2-cea8-4415-a909-65f9792c23f2-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:34 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.674s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-d28f9cd2-cea8-4415-a909-65f9792c23f2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Deleted volume successfully. Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4721999b-23e8-46a4-b325-9144174b26dd tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-285c8775-0d37-4616-a9af-2e50d43fb049-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "cinder-quobyte-d28f9cd2-cea8-4415-a909-65f9792c23f2" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-quobyte-d28f9cd2-cea8-4415-a909-65f9792c23f2" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:34 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[15452ece-b6e8-4e7c-8ff2-100d046b3ed5]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d28f9cd2-cea8-4415-a909-65f9792c23f2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:34 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d57bf5-feb1-47e2-88f3-43827df612bb -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab" returned: 0 in 0.733s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:34 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab is being set with open permissions: ugo+rw Jun 01 09:50:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:34 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab Jun 01 09:50:34 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:34 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d28f9cd2-cea8-4415-a909-65f9792c23f2 Jun 01 09:50:34 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:34 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD Jun 01 09:50:34 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:35 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab" returned: 0 in 0.641s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:35 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d28f9cd2-cea8-4415-a909-65f9792c23f2" returned: 0 in 0.694s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:35 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d28f9cd2-cea8-4415-a909-65f9792c23f2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:35 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d28f9cd2-cea8-4415-a909-65f9792c23f2 Jun 01 09:50:35 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD" returned: 1 in 0.712s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:50:35 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] 86e77745-271a-4791-bec1-f6fdfebd41dc was raw, converting to raw {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 01 09:50:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:35 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.info Jun 01 09:50:35 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:35 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 Jun 01 09:50:35 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:36 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-d28f9cd2-cea8-4415-a909-65f9792c23f2" returned: 0 in 0.578s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-quobyte-d28f9cd2-cea8-4415-a909-65f9792c23f2" released by "delete_volume" :: held 1.318s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Created reservations ['96a450da-abfa-428c-90ce-d54bcb766dcf', '0496f4e4-f7c8-471c-aa48-b42638c9b42c', '3e06278d-8ffc-44d9-8a32-49d00944ec7f', '0e27848a-062e-44ec-aeab-d8f2c76997c8'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:50:36 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.info" returned: 0 in 0.636s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:36 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.info is being set with open permissions: ugo+rw Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:36 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.info Jun 01 09:50:36 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:36 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547" returned: 0 in 0.724s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86e77745-271a-4791-bec1-f6fdfebd41dc_qiq73bhxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:50:36 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Converted 0.00 MB image at 0.00 MB/s Jun 01 09:50:36 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:50:36 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:36 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 1G Jun 01 09:50:36 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:36 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.info" returned: 0 in 0.637s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:36 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:50:36 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.311s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.286s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] Creating offline snapshot fcda9954-2ba6-4708-af18-6ccc758fb785 of volume 6f5efa66-fb40-46bb-92d3-72b44353fd82 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[50976921-b6df-4333-b3f2-672e7938f37d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:36 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2eb30edc-f3e6-4840-af69-fae2ea6d6928 tempest-CreateVolumesFromSnapshotTest-687761034 None] Create snapshot completed successfully Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.643s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:50:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Deleted volume successfully. Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6cc99865-e39b-4d94-85d1-d404520d89cc tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-d28f9cd2-cea8-4415-a909-65f9792c23f2-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "cinder-4a24d242-774b-447e-a389-04305f2cc8c3-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:36 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 Jun 01 09:50:36 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-4a24d242-774b-447e-a389-04305f2cc8c3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:36 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 1G" returned: 0 in 0.766s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "cinder-quobyte-4a24d242-774b-447e-a389-04305f2cc8c3" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-quobyte-4a24d242-774b-447e-a389-04305f2cc8c3" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3574523-f536-4f87-b381-0fd662dc1a9f]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[527b3622-4837-4fe6-bc8e-5055a7e5071b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4a24d242-774b-447e-a389-04305f2cc8c3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:37 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 Jun 01 09:50:37 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:37 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4a24d242-774b-447e-a389-04305f2cc8c3 Jun 01 09:50:37 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:37 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.664s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:50:37 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82" returned: 0 in 0.887s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:37 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 1G Jun 01 09:50:37 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:37 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4a24d242-774b-447e-a389-04305f2cc8c3" returned: 0 in 0.762s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4a24d242-774b-447e-a389-04305f2cc8c3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:37 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547" returned: 0 in 0.797s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:37 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4a24d242-774b-447e-a389-04305f2cc8c3 Jun 01 09:50:37 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:37 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 Jun 01 09:50:37 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Flow 'volume_create_manager' (fd1ac91c-e4f7-440a-91a7-4ef2bc1f7ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3436fa43-c4e0-4a81-8191-28305b711964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3436fa43-c4e0-4a81-8191-28305b711964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-262576828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cbf3034-0e58-48d8-87e6-bb4147710b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa30abe17f964004a5f5221d361d6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:38Z,use_quota=True,user_id='76e75f5ad6d442aeb21a541eb47fea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b66694-4480-46d3-b17b-34f3ead6ae7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b66694-4480-46d3-b17b-34f3ead6ae7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ddc336-9d47-4116-9470-66f968294b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ddc336-9d47-4116-9470-66f968294b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cbf3034-0e58-48d8-87e6-bb4147710b6f', 'volume_name': 'volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d099333-186d-42a1-ba0e-f709c6b9c41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d099333-186d-42a1-ba0e-f709c6b9c41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb58c86-c8fb-4794-9f03-8e3578633f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:38 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume 5cbf3034-0e58-48d8-87e6-bb4147710b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f', 'volume_size': 1} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:38 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:38 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Flow 'volume_create_manager' (63204f08-c889-49c0-89cb-a5a3827aa0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8727ea9a-2dda-4434-a465-ff98143175d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-4a24d242-774b-447e-a389-04305f2cc8c3" returned: 0 in 0.877s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 1G" returned: 0 in 1.001s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8727ea9a-2dda-4434-a465-ff98143175d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1928863281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4caade-005c-4880-8aac-90edf37e87d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa30abe17f964004a5f5221d361d6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:39Z,use_quota=True,user_id='76e75f5ad6d442aeb21a541eb47fea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa6cef5-1fa0-4438-b6ca-43dab86365a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa6cef5-1fa0-4438-b6ca-43dab86365a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657617b0-cc6b-412d-a28e-1d932fab2fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657617b0-cc6b-412d-a28e-1d932fab2fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c4caade-005c-4880-8aac-90edf37e87d7', 'volume_name': 'volume-3c4caade-005c-4880-8aac-90edf37e87d7', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d20989-1bce-4a0b-81b5-b5468206ca99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d20989-1bce-4a0b-81b5-b5468206ca99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74bc22e-7321-46ba-a66e-6102b8c2e894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:38 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume 3c4caade-005c-4880-8aac-90edf37e87d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c4caade-005c-4880-8aac-90edf37e87d7', 'volume_size': 1} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-quobyte-4a24d242-774b-447e-a389-04305f2cc8c3" released by "delete_volume" :: held 1.771s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:38 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 Jun 01 09:50:38 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:38 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547" returned: 1 in 0.986s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Downloaded image 86e77745-271a-4791-bec1-f6fdfebd41dc ((None, [{'url': 'file:///opt/stack/data/glance/images/86e77745-271a-4791-bec1-f6fdfebd41dc', 'metadata': {}}])) to volume 341aeb0d-f70a-4e57-aab4-6f7256360547 successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Temporary image 86e77745-271a-4791-bec1-f6fdfebd41dc for user 9d782e36c73b4389a01c0f103bb6113c is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Marking volume 341aeb0d-f70a-4e57-aab4-6f7256360547 as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Copying metadata from image 86e77745-271a-4791-bec1-f6fdfebd41dc to 341aeb0d-f70a-4e57-aab4-6f7256360547. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Creating volume glance metadata for volume 341aeb0d-f70a-4e57-aab4-6f7256360547 backed by image 86e77745-271a-4791-bec1-f6fdfebd41dc with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '86e77745-271a-4791-bec1-f6fdfebd41dc', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3a6d79ff8a229f0ec54a0d825f461979', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Created reservations ['15e99310-7173-4833-83d7-7c032be9e727', 'fabd654e-47f3-4dd4-bdb6-8ce19ead6dd9', 'e71fdca6-b050-4049-9f9e-244bf78fdc69', 'c78e4927-6a93-4f7b-a8e6-28a58e51eb50'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:38 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:50:38 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605eb1b5-e6e5-4e64-ba84-ae4cad444c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-341aeb0d-f70a-4e57-aab4-6f7256360547', 'volume_size': 1, 'image_id': '86e77745-271a-4791-bec1-f6fdfebd41dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86e77745-271a-4791-bec1-f6fdfebd41dc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a6d79ff8a229f0ec54a0d825f461979', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37f0d3e45f234bf9afb6576a2c70e719', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eaa672605708d81a0891821a4104a3778df204387c182753b379943b4de52c72bc07b11056397f948c9b5047ca358fa1756443a3a237e7ee2dd23c13f4790da4', 'id': '86e77745-271a-4791-bec1-f6fdfebd41dc', 'created_at': datetime.datetime(2026, 6, 1, 7, 50, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 50, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86e77745-271a-4791-bec1-f6fdfebd41dc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aae4a14-325c-4374-8f44-53d7734f74c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:39 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Volume volume-341aeb0d-f70a-4e57-aab4-6f7256360547 (341aeb0d-f70a-4e57-aab4-6f7256360547): created successfully Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aae4a14-325c-4374-8f44-53d7734f74c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Flow 'volume_create_manager' (bb72ff9b-bf81-4bce-912a-6bbdac1c40f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Flow 'volume_create_manager' (a53da34e-bbeb-415b-a085-1bc907da1c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfc74c6-e016-4da5-94de-d78093679c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:39 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4cf59519-5ab6-4f32-83b2-54c537ef2d04 tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Created volume successfully. Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfc74c6-e016-4da5-94de-d78093679c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-478357128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa30abe17f964004a5f5221d361d6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:39Z,use_quota=True,user_id='76e75f5ad6d442aeb21a541eb47fea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27c6672-acf5-4e41-9daa-f34a6aef9781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27c6672-acf5-4e41-9daa-f34a6aef9781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801835ba-ef7e-4234-8a66-28d1cfa51770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801835ba-ef7e-4234-8a66-28d1cfa51770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a', 'volume_name': 'volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4d02c7-675e-45a3-9e35-400627d6b10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4d02c7-675e-45a3-9e35-400627d6b10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe24bb9f-7adb-4f9a-a181-d5750cd9af95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:39 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a', 'volume_size': 1} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "cinder-7916133b-1fbb-445d-8f70-398f529848e6-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-7916133b-1fbb-445d-8f70-398f529848e6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "cinder-quobyte-7916133b-1fbb-445d-8f70-398f529848e6" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-quobyte-7916133b-1fbb-445d-8f70-398f529848e6" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d778ded-9f11-43ef-8d0d-4cbe62073c1f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7916133b-1fbb-445d-8f70-398f529848e6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:39 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7916133b-1fbb-445d-8f70-398f529848e6 Jun 01 09:50:39 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Flow 'volume_create_manager' (b605fe14-ece8-4e5e-8827-6513f79210d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:39 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d9050f-e302-40fc-9b6c-0f146b99bf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785" returned: 0 in 0.915s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:39 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 is being set with open permissions: ugo+rw Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d9050f-e302-40fc-9b6c-0f146b99bf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-984094465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa30abe17f964004a5f5221d361d6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:40Z,use_quota=True,user_id='76e75f5ad6d442aeb21a541eb47fea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:39 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 Jun 01 09:50:39 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a603ed-a229-4978-a7ca-4e56cf49e1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a603ed-a229-4978-a7ca-4e56cf49e1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2543af47-a9bb-44fd-afe8-dab94c0987c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2543af47-a9bb-44fd-afe8-dab94c0987c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c', 'volume_name': 'volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ffd82c-041b-44fe-a5c9-c169c102c181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ffd82c-041b-44fe-a5c9-c169c102c181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d71122d-a53d-44d0-b3c0-5b55f1a0b892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:39 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume 9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c', 'volume_size': 1} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Acquiring lock "cinder-341aeb0d-f70a-4e57-aab4-6f7256360547-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Lock "cinder-341aeb0d-f70a-4e57-aab4-6f7256360547-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:39 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.933s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:50:39 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Deleted volume successfully. Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Acquiring lock "cinder-quobyte-341aeb0d-f70a-4e57-aab4-6f7256360547" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Lock "cinder-quobyte-341aeb0d-f70a-4e57-aab4-6f7256360547" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a2c7aff-61e9-45e9-9d1f-b86d25ac83dc tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-4a24d242-774b-447e-a389-04305f2cc8c3-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab5dc4a-9abc-432e-8658-924ef28c18c6]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Flow 'volume_create_manager' (8a20eb9c-1c71-4003-8c8f-fe59bc8c236b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc0a44b-3490-4679-b494-585321f1b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc0a44b-3490-4679-b494-585321f1b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-345999524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa30abe17f964004a5f5221d361d6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:40Z,use_quota=True,user_id='76e75f5ad6d442aeb21a541eb47fea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410c42fb-1248-438e-862c-2aa1441dc871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410c42fb-1248-438e-862c-2aa1441dc871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8aa3121-108f-450a-9706-1945297451a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8aa3121-108f-450a-9706-1945297451a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe', 'volume_name': 'volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:40 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 Jun 01 09:50:40 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bac8b55-834f-49e5-b939-637cb98fd22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bac8b55-834f-49e5-b939-637cb98fd22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213d5946-5a6a-484c-83e4-0445b8769395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:40 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe', 'volume_size': 1} Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:40 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7916133b-1fbb-445d-8f70-398f529848e6" returned: 0 in 0.969s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7916133b-1fbb-445d-8f70-398f529848e6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:40 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7916133b-1fbb-445d-8f70-398f529848e6 Jun 01 09:50:40 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:40 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785" returned: 0 in 0.782s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:40 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.info Jun 01 09:50:40 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:40 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547" returned: 0 in 0.706s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:40 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 Jun 01 09:50:40 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:40 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-7916133b-1fbb-445d-8f70-398f529848e6" returned: 0 in 0.626s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-quobyte-7916133b-1fbb-445d-8f70-398f529848e6" released by "delete_volume" :: held 1.651s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Created reservations ['a7f4f21c-a5a0-4833-9a39-bd860f32c359', 'fbab69d0-1a40-4da1-b502-9dbb74627843', '098e72c8-664a-4697-b0c4-6d8046ce06d7', 'e673d664-5c6a-4805-80bc-b0ae1517460c'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:50:41 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.info" returned: 0 in 0.653s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:41 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.info is being set with open permissions: ugo+rw Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:41 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:50:41 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:41 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.info Jun 01 09:50:41 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:41 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547" returned: 1 in 0.706s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:41 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547 Jun 01 09:50:41 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:41 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.634s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:50:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Deleted volume successfully. Jun 01 09:50:41 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e1e15e92-9fac-46bd-a09a-e1bcb447f2d3 tempest-CreateVolumesFromImageTest-2113971225 None] Lock "cinder-7916133b-1fbb-445d-8f70-398f529848e6-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.info" returned: 0 in 0.659s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.072s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.603s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-262576828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cbf3034-0e58-48d8-87e6-bb4147710b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa30abe17f964004a5f5221d361d6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:38Z,use_quota=True,user_id='76e75f5ad6d442aeb21a541eb47fea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Creating volume 5cbf3034-0e58-48d8-87e6-bb4147710b6f {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:41 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:41 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f 1073741824 Jun 01 09:50:41 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e761746f-cf02-4e97-afae-bb78dc870e06 tempest-CinderUnicodeTest-1373426053 None] Create snapshot completed successfully Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Acquiring lock "cinder-fcda9954-2ba6-4708-af18-6ccc758fb785-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Lock "cinder-fcda9954-2ba6-4708-af18-6ccc758fb785-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Acquiring lock "cinder-quobyte-6f5efa66-fb40-46bb-92d3-72b44353fd82" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Lock "cinder-quobyte-6f5efa66-fb40-46bb-92d3-72b44353fd82" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Acquiring lock "cinder-quobyte-fcda9954-2ba6-4708-af18-6ccc758fb785" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:42 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-341aeb0d-f70a-4e57-aab4-6f7256360547" returned: 0 in 0.731s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Lock "cinder-quobyte-fcda9954-2ba6-4708-af18-6ccc758fb785" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Deleting offline snapshot fcda9954-2ba6-4708-af18-6ccc758fb785 of volume 6f5efa66-fb40-46bb-92d3-72b44353fd82 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] snapshot_file for this snap is: volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Lock "cinder-quobyte-341aeb0d-f70a-4e57-aab4-6f7256360547" released by "delete_volume" :: held 2.272s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d54093e-5f66-4b7f-a407-297a71c57099]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Created reservations ['b47d2d8f-fd88-4904-b081-2a7f2b7a40ca', '3ac3a28f-41a2-4809-987e-e54f0b896259', '850252c1-8270-4b89-a106-0ae17b159d45', '4e5e5b90-1310-4739-a51b-bcaef279eb0e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:50:42 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 Jun 01 09:50:42 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:42 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:50:42 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:42 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f 1073741824" returned: 0 in 1.086s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:43 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f Jun 01 09:50:43 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:43 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785" returned: 0 in 0.974s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f5efa66-fb40-46bb-92d3-72b44353fd82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:50:43 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.787s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:50:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Deleted volume successfully. Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c19def-ff7a-4df1-be29-78e85380ba23]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fcbe3287-db61-4f34-acb7-eee8e53077dc tempest-VolumeAndVolumeTypeFromImageTest-404966276 None] Lock "cinder-341aeb0d-f70a-4e57-aab4-6f7256360547-delete_volume" released by "delete_volume" :: held 3.466s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:43 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 Jun 01 09:50:43 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:43 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f" returned: 0 in 0.745s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.973s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1928863281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4caade-005c-4880-8aac-90edf37e87d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa30abe17f964004a5f5221d361d6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:39Z,use_quota=True,user_id='76e75f5ad6d442aeb21a541eb47fea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Creating volume 3c4caade-005c-4880-8aac-90edf37e87d7 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:43 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c4caade-005c-4880-8aac-90edf37e87d7 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb58c86-c8fb-4794-9f03-8e3578633f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c233ef1-bc88-4496-bf8c-65d80c4aad35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:43 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c4caade-005c-4880-8aac-90edf37e87d7 1073741824 Jun 01 09:50:43 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:43 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f (5cbf3034-0e58-48d8-87e6-bb4147710b6f): created successfully Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c233ef1-bc88-4496-bf8c-65d80c4aad35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Flow 'volume_create_manager' (fd1ac91c-e4f7-440a-91a7-4ef2bc1f7ab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-71c2ecaf-bf43-4aa8-b974-8cd3c9ab5f88 tempest-CreateVolumesFromSnapshotTest-687761034 None] Created volume successfully. Jun 01 09:50:44 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82" returned: 0 in 0.841s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:44 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 Jun 01 09:50:44 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:44 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c4caade-005c-4880-8aac-90edf37e87d7 1073741824" returned: 0 in 1.084s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c4caade-005c-4880-8aac-90edf37e87d7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:44 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785" returned: 0 in 0.820s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:44 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785 Jun 01 09:50:44 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:44 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c4caade-005c-4880-8aac-90edf37e87d7 Jun 01 09:50:44 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Flow 'volume_create_manager' (65abdd9a-1b52-4c09-9f06-7641bbaecc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77aabc00-a2e1-4303-a99b-ce585e0e1f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77aabc00-a2e1-4303-a99b-ce585e0e1f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1849594111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e9d30a-93b9-4a4c-9bab-21f6af53d137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c59733e0a1f46a59f47035276195859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:45Z,use_quota=True,user_id='f19a965e49ff4bc0b8c7ae5b829a1812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb16a90-b509-4b47-a17f-86074b58d1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb16a90-b509-4b47-a17f-86074b58d1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff17a0db-99f8-4474-bd7f-1a540753ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff17a0db-99f8-4474-bd7f-1a540753ef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e9d30a-93b9-4a4c-9bab-21f6af53d137', 'volume_name': 'volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634ddf4c-b871-4d3c-afc3-3a97a95345ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634ddf4c-b871-4d3c-afc3-3a97a95345ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941acee5-c327-4b7e-8469-2ab7acc60512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:45 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Volume a1e9d30a-93b9-4a4c-9bab-21f6af53d137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137', 'volume_size': 1} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:45 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82.fcda9954-2ba6-4708-af18-6ccc758fb785" returned: 0 in 0.661s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Lock "cinder-quobyte-fcda9954-2ba6-4708-af18-6ccc758fb785" released by "_delete_snapshot" :: held 3.460s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Lock "cinder-quobyte-6f5efa66-fb40-46bb-92d3-72b44353fd82" released by "delete_snapshot" :: held 3.504s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:45 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c4caade-005c-4880-8aac-90edf37e87d7" returned: 0 in 0.756s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.424s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-478357128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa30abe17f964004a5f5221d361d6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:39Z,use_quota=True,user_id='76e75f5ad6d442aeb21a541eb47fea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Creating volume f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:45 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:45 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a 1073741824 Jun 01 09:50:45 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74bc22e-7321-46ba-a66e-6102b8c2e894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c4caade-005c-4880-8aac-90edf37e87d7', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1a86de-bb30-49fd-aae3-2d6a7990c89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:45 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume volume-3c4caade-005c-4880-8aac-90edf37e87d7 (3c4caade-005c-4880-8aac-90edf37e87d7): created successfully Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1a86de-bb30-49fd-aae3-2d6a7990c89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Flow 'volume_create_manager' (63204f08-c889-49c0-89cb-a5a3827aa0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1afbd083-ede5-4b5b-9886-040d911835e1 tempest-CreateVolumesFromSnapshotTest-687761034 None] Created volume successfully. Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Created reservations ['a37e8b74-5f4a-4b69-9e19-a32b356191b5', 'f5cea759-0ff5-493b-86a3-1501763cfecc', '6270003b-5912-4202-8f27-6725ea3bdb55', '98b45e2d-3c19-4e74-bca3-7c1b753df01d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:50:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Delete snapshot completed successfully. Jun 01 09:50:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b194814-d6bc-4ab1-a33a-1f605171f1f7 tempest-CinderUnicodeTest-1373426053 None] Lock "cinder-fcda9954-2ba6-4708-af18-6ccc758fb785-delete_snapshot" released by "delete_snapshot" :: held 3.752s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Acquiring lock "cinder-6f5efa66-fb40-46bb-92d3-72b44353fd82-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Lock "cinder-6f5efa66-fb40-46bb-92d3-72b44353fd82-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Acquiring lock "cinder-quobyte-6f5efa66-fb40-46bb-92d3-72b44353fd82" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Lock "cinder-quobyte-6f5efa66-fb40-46bb-92d3-72b44353fd82" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3b4655-d765-448a-a2e9-bde7c2655d66]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:46 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a 1073741824" returned: 0 in 0.952s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:46 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 Jun 01 09:50:46 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:46 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a Jun 01 09:50:46 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:47 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:47 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a" returned: 0 in 0.669s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82" returned: 0 in 0.768s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.543s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-984094465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa30abe17f964004a5f5221d361d6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:40Z,use_quota=True,user_id='76e75f5ad6d442aeb21a541eb47fea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Creating volume 9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:47 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:47 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c 1073741824 Jun 01 09:50:47 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe24bb9f-7adb-4f9a-a181-d5750cd9af95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:47 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82 Jun 01 09:50:47 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9da0ae5-560d-4dab-babe-6abc43cb9a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:47 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a (f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a): created successfully Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9da0ae5-560d-4dab-babe-6abc43cb9a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Flow 'volume_create_manager' (a53da34e-bbeb-415b-a085-1bc907da1c3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0ee971ba-f533-4eb3-8bbb-feee15876147 tempest-CreateVolumesFromSnapshotTest-687761034 None] Created volume successfully. Jun 01 09:50:47 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6f5efa66-fb40-46bb-92d3-72b44353fd82" returned: 0 in 0.643s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Lock "cinder-quobyte-6f5efa66-fb40-46bb-92d3-72b44353fd82" released by "delete_volume" :: held 1.502s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Created reservations ['036533cb-7aad-4b63-9d41-676b63c7cf6a', 'e491e2b1-e16d-4f90-aa8b-b0459de260c9', '33a17f6b-f656-4e45-925b-d2366b4122cc', '997e2a64-f050-4c90-b843-9bd8b749f8ad'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:48 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c 1073741824" returned: 0 in 0.837s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:48 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:50:48 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:48 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c Jun 01 09:50:48 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Acquiring lock "cinder-6be28f1d-b2b1-43ab-a040-b0084c2bc769-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Lock "cinder-6be28f1d-b2b1-43ab-a040-b0084c2bc769-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Acquiring lock "cinder-quobyte-6be28f1d-b2b1-43ab-a040-b0084c2bc769" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Lock "cinder-quobyte-6be28f1d-b2b1-43ab-a040-b0084c2bc769" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1c8abe-560f-4780-8ad9-94728933cfdb]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:48 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c" returned: 0 in 0.649s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.734s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-345999524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa30abe17f964004a5f5221d361d6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:40Z,use_quota=True,user_id='76e75f5ad6d442aeb21a541eb47fea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Creating volume df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:48 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:48 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.753s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d71122d-a53d-44d0-b3c0-5b55f1a0b892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:48 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe 1073741824 Jun 01 09:50:48 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7fc349e-7829-498e-9b2b-bc17410480d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Deleted volume successfully. Jun 01 09:50:48 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769 Jun 01 09:50:48 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:48 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c (9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c): created successfully Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7fc349e-7829-498e-9b2b-bc17410480d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Flow 'volume_create_manager' (b605fe14-ece8-4e5e-8827-6513f79210d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-983993e7-bc87-4e92-91ae-3cbf267cd83d tempest-CinderUnicodeTest-1373426053 None] Lock "cinder-6f5efa66-fb40-46bb-92d3-72b44353fd82-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c95c9ab7-52f9-470d-a467-46852b453920 tempest-CreateVolumesFromSnapshotTest-687761034 None] Created volume successfully. Jun 01 09:50:49 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769" returned: 0 in 0.763s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:49 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769 Jun 01 09:50:49 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:49 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe 1073741824" returned: 0 in 0.869s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:49 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe Jun 01 09:50:49 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:50 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-6be28f1d-b2b1-43ab-a040-b0084c2bc769" returned: 0 in 0.676s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Lock "cinder-quobyte-6be28f1d-b2b1-43ab-a040-b0084c2bc769" released by "delete_volume" :: held 1.520s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Flow 'volume_create_manager' (8732afb1-4aae-4d05-87ae-dac7dfea3b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c44e18-0cb1-4a56-86e0-688a4e8a1703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c44e18-0cb1-4a56-86e0-688a4e8a1703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6bd39c-c0f6-4961-b56d-15b00be401b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fff9ea3fd024adc8fb75fa0fa4e288d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:50Z,use_quota=True,user_id='5f2fa6bd473d40dd92ba6f637698e5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6e3a7e-c78a-4972-9906-833b4d482e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6e3a7e-c78a-4972-9906-833b4d482e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c438ee2-fcb5-4d1b-b7f9-d758b9020c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Created reservations ['18157129-cd4c-47ae-ba77-fd93703195b6', 'b9ff12cf-0f07-428f-aacc-d3af0ec05d7c', '195313ed-d50c-4cc2-ae67-e932cdf23909', '02cd3b73-23d5-404b-8d6e-aec0bdf67fe7'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:50:50 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe" returned: 0 in 0.665s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.332s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1849594111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e9d30a-93b9-4a4c-9bab-21f6af53d137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c59733e0a1f46a59f47035276195859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:45Z,use_quota=True,user_id='f19a965e49ff4bc0b8c7ae5b829a1812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Creating volume a1e9d30a-93b9-4a4c-9bab-21f6af53d137 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:50 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:50 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 1073741824 Jun 01 09:50:50 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213d5946-5a6a-484c-83e4-0445b8769395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85161b5d-6eac-4018-bb47-7cf0eb01da81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:50 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:50:50 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:50 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Volume volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe (df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe): created successfully Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85161b5d-6eac-4018-bb47-7cf0eb01da81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Flow 'volume_create_manager' (8a20eb9c-1c71-4003-8c8f-fe59bc8c236b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-720e603a-c880-49f1-810a-d5e2c03e3cb4 tempest-CreateVolumesFromSnapshotTest-687761034 None] Created volume successfully. Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c438ee2-fcb5-4d1b-b7f9-d758b9020c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0a6bd39c-c0f6-4961-b56d-15b00be401b3', 'volume_name': 'volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3', 'volume_size': 1, 'image_id': 'cace99d6-d9a6-41df-b35a-c941b4b2a090', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cace99d6-d9a6-41df-b35a-c941b4b2a090', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2bbd7f7ce1e651f43c0983e998ff34f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5fff9ea3fd024adc8fb75fa0fa4e288d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f780f690f6b60d5f3c65fdaf45a25f227ccd871739d5783753c81bf25e8cc85c0d853fb3b64fc423678c30327fe9cc877bde45d14242272f46cd513e466470e1', 'id': 'cace99d6-d9a6-41df-b35a-c941b4b2a090', 'created_at': datetime.datetime(2026, 6, 1, 7, 50, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 50, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cace99d6-d9a6-41df-b35a-c941b4b2a090/file', 'properties': {}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9c09c1-1f0a-4de2-8962-8c48ddaf9ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9c09c1-1f0a-4de2-8962-8c48ddaf9ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30450c88-400f-475e-97bb-dcdedcbc989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:50 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Volume 0a6bd39c-c0f6-4961-b56d-15b00be401b3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3', 'volume_size': 1, 'image_id': 'cace99d6-d9a6-41df-b35a-c941b4b2a090', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cace99d6-d9a6-41df-b35a-c941b4b2a090', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2bbd7f7ce1e651f43c0983e998ff34f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5fff9ea3fd024adc8fb75fa0fa4e288d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f780f690f6b60d5f3c65fdaf45a25f227ccd871739d5783753c81bf25e8cc85c0d853fb3b64fc423678c30327fe9cc877bde45d14242272f46cd513e466470e1', 'id': 'cace99d6-d9a6-41df-b35a-c941b4b2a090', 'created_at': datetime.datetime(2026, 6, 1, 7, 50, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 50, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cace99d6-d9a6-41df-b35a-c941b4b2a090/file', 'properties': {}}, 'image_service': } Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Trying to clone 0a6bd39c-c0f6-4961-b56d-15b00be401b3 from image cace99d6-d9a6-41df-b35a-c941b4b2a090 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cace99d6-d9a6-41df-b35a-c941b4b2a090', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 01 09:50:50 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Image download 0.00 MB at 0.00 MB/s Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e54bd0-b975-4e77-8216-9aa2523c046a]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:50 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD Jun 01 09:50:50 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:51 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.672s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:51 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:50:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Deleted volume successfully. Jun 01 09:50:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-893253ee-ccd1-4327-b243-e7d6601e5481 tempest-CinderUnicodeTest-1373426053 None] Lock "cinder-6be28f1d-b2b1-43ab-a040-b0084c2bc769-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-quobyte-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:51 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4454d4db-cb2d-4f4f-b954-ff11f43473aa]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:51 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 1073741824" returned: 0 in 0.996s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:51 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe Jun 01 09:50:51 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:51 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 Jun 01 09:50:51 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:51 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD" returned: 0 in 0.861s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:51 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD Jun 01 09:50:51 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:52 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe" returned: 0 in 0.883s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:52 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137" returned: 0 in 0.736s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:52 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe Jun 01 09:50:52 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941acee5-c327-4b7e-8469-2ab7acc60512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134bfcb4-a299-4107-9e6b-f7a04dd8bcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:52 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Volume volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 (a1e9d30a-93b9-4a4c-9bab-21f6af53d137): created successfully Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134bfcb4-a299-4107-9e6b-f7a04dd8bcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Flow 'volume_create_manager' (65abdd9a-1b52-4c09-9f06-7641bbaecc96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5fae731c-ad15-4504-907d-f88480352bb1 tempest-VolumeDependencyTests-1819099694 None] Created volume successfully. Jun 01 09:50:52 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD" returned: 1 in 0.927s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Temporary image cace99d6-d9a6-41df-b35a-c941b4b2a090 is fetched for user 5f2fa6bd473d40dd92ba6f637698e5d1. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9fd9a2-f9ff-47d8-b5be-8fc2c92a60e1]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] Creating offline snapshot e4cf2da2-4ade-4b59-829a-1db9964f0401 of volume a1e9d30a-93b9-4a4c-9bab-21f6af53d137 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6dd03d-6d90-4d1d-8776-a03852a8e192]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:52 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD Jun 01 09:50:52 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:52 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 Jun 01 09:50:52 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:53 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe" returned: 0 in 0.818s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe" released by "delete_volume" :: held 1.767s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Created reservations ['572227f3-2245-49b5-9905-06b89df7e1ee', '18469f94-4ed5-4fc8-9258-9c4f44a8ba9c', '0354bfb4-c3b6-4701-8712-54afd87f59f0', 'f2ba8e91-b4b9-4266-b8e9-d2d0fd1447be'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:53 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:50:53 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:53 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-quobyte-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3ac21d-d260-48f0-93a9-6f62fb882492]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:53 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137" returned: 0 in 0.889s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:53 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD Jun 01 09:50:53 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:53 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 1G Jun 01 09:50:53 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:53 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c Jun 01 09:50:53 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:54 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.877s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:50:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Deleted volume successfully. Jun 01 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-972b93f1-7268-4b07-b2a0-67022db8f4ad tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-df1a5f2c-ef4f-421f-8890-99bdfc1ae3fe-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:54 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD" returned: 1 in 0.868s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:54 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c" returned: 0 in 0.878s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:54 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c Jun 01 09:50:54 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:54 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 1G" returned: 0 in 0.902s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:54 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 Jun 01 09:50:54 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:55 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c" returned: 0 in 0.737s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c" released by "delete_volume" :: held 1.660s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:55 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401" returned: 0 in 0.730s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:55 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 is being set with open permissions: ugo+rw Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:55 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 Jun 01 09:50:55 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Created reservations ['bf467c51-a8ca-4a9d-a0e6-78e1c11ec292', 'e8863eb1-3c6f-4d07-aecc-8818412c6605', '709acc01-e176-4a3d-8372-88795f714d09', '38ca2b84-4a52-461e-9ef7-4a9340f3c6cc'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:55 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:50:55 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-quobyte-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a" acquired by "delete_volume" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[410baa69-6c1d-4841-a5ff-5d9214257048]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:56 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401" returned: 0 in 0.707s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:56 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a Jun 01 09:50:56 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:56 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.info Jun 01 09:50:56 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:56 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.706s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:56 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:50:56 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Deleted volume successfully. Jun 01 09:50:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-03197b12-3a1b-4d48-a692-be0d9f083375 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-9c21bbdc-5c3e-4312-a79c-4b878cf6cc1c-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:56 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a" returned: 0 in 0.777s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:56 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.info" returned: 0 in 0.655s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:56 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.info is being set with open permissions: ugo+rw Jun 01 09:50:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:56 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a Jun 01 09:50:56 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:56 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.info Jun 01 09:50:56 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:57 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.info" returned: 0 in 0.635s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:57 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.631s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.966s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6bd39c-c0f6-4961-b56d-15b00be401b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fff9ea3fd024adc8fb75fa0fa4e288d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:50Z,use_quota=True,user_id='5f2fa6bd473d40dd92ba6f637698e5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Creating volume 0a6bd39c-c0f6-4961-b56d-15b00be401b3 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:57 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a" returned: 0 in 0.727s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:57 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 1073741824 Jun 01 09:50:57 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a" released by "delete_volume" :: held 1.570s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8e76612b-9cfd-4e1c-ba68-4e19ccf56c23 tempest-VolumeDependencyTests-1819099694 None] Create snapshot completed successfully Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Created reservations ['fce16f2a-1f4b-4d42-8075-c3df87d3e0b7', '5148c75d-bf89-4682-8628-33c9b77f8411', '575ba432-d026-401e-9db0-41f28edd5464', 'a73c4bc0-07c3-47e9-aa41-31ca999ff445'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:57 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:50:57 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-3c4caade-005c-4880-8aac-90edf37e87d7-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-3c4caade-005c-4880-8aac-90edf37e87d7-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=157,cinder:SELECT=126,cinder:INSERT=44,cinder:DELETE=17 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-quobyte-3c4caade-005c-4880-8aac-90edf37e87d7" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-3c4caade-005c-4880-8aac-90edf37e87d7" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[080cb1e2-6bd3-4b5c-93c4-2e179aa184a7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c4caade-005c-4880-8aac-90edf37e87d7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:58 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.769s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:50:58 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Deleted volume successfully. Jun 01 09:50:58 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 1073741824" returned: 0 in 1.017s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:58 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c4caade-005c-4880-8aac-90edf37e87d7 Jun 01 09:50:58 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b315682-f67a-46ac-a0c3-3c95fbcfff5e tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-f0aab5a2-d9c7-4097-a0d0-52b98fc8e44a-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:58 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 Jun 01 09:50:58 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Flow 'volume_create_manager' (daddda04-b92f-4c3f-8ce2-664c88817142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7986ac8-abd2-4dc4-b2b8-1e9275fdd939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7986ac8-abd2-4dc4-b2b8-1e9275fdd939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1637283039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef68f84-5e64-40c5-ba7b-a2c30e3bb903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c59733e0a1f46a59f47035276195859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e4cf2da2-4ade-4b59-829a-1db9964f0401,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:50:59Z,use_quota=True,user_id='f19a965e49ff4bc0b8c7ae5b829a1812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe31596-df16-480a-9200-c56123801300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe31596-df16-480a-9200-c56123801300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635a2801-3e5f-4cc2-b7c1-38582d261617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635a2801-3e5f-4cc2-b7c1-38582d261617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5ef68f84-5e64-40c5-ba7b-a2c30e3bb903', 'volume_name': 'volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903', 'volume_size': 1, 'snapshot_id': 'e4cf2da2-4ade-4b59-829a-1db9964f0401'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc82c6e-92ed-4d4f-8f0d-ab78bbe4949d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc82c6e-92ed-4d4f-8f0d-ab78bbe4949d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65b8583-447a-436e-8f05-897ec84bf180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:50:58 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Volume 5ef68f84-5e64-40c5-ba7b-a2c30e3bb903: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903', 'volume_size': 1, 'snapshot_id': 'e4cf2da2-4ade-4b59-829a-1db9964f0401'} Jun 01 09:50:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:59 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c4caade-005c-4880-8aac-90edf37e87d7" returned: 0 in 0.991s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c4caade-005c-4880-8aac-90edf37e87d7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:59 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c4caade-005c-4880-8aac-90edf37e87d7 Jun 01 09:50:59 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:59 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3" returned: 0 in 0.871s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.547s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "cinder-quobyte-e4cf2da2-4ade-4b59-829a-1db9964f0401-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-quobyte-e4cf2da2-4ade-4b59-829a-1db9964f0401-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Creating volume 5ef68f84-5e64-40c5-ba7b-a2c30e3bb903 from snapshot e4cf2da2-4ade-4b59-829a-1db9964f0401 {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "cinder-quobyte-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Attempting download of cace99d6-d9a6-41df-b35a-c941b4b2a090 ((None, [{'url': 'file:///opt/stack/data/glance/images/cace99d6-d9a6-41df-b35a-c941b4b2a090', 'metadata': {}}])) to volume 0a6bd39c-c0f6-4961-b56d-15b00be401b3. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-quobyte-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] snapshot: e4cf2da2-4ade-4b59-829a-1db9964f0401, volume: 5ef68f84-5e64-40c5-ba7b-a2c30e3bb903, {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a15467-3777-46ec-9fc0-fcfde0e393e6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5d2104-f613-415f-b288-86fa24d0475d]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:50:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cace99d6-d9a6-41df-b35a-c941b4b2a090_x3w9p1a7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:50:59 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 Jun 01 09:50:59 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:50:59 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cace99d6-d9a6-41df-b35a-c941b4b2a090_x3w9p1a7 Jun 01 09:50:59 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:00 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-3c4caade-005c-4880-8aac-90edf37e87d7" returned: 0 in 0.788s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-3c4caade-005c-4880-8aac-90edf37e87d7" released by "delete_volume" :: held 1.841s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Created reservations ['ddfe0bf7-7dab-45bb-af73-89671db1a203', '3da703d6-1cb6-4bdb-af49-971a424c1159', 'ed67b568-eda0-4d70-8f7a-b430400e7563', '633d784b-0d59-4788-a3bf-0ec62a55bae7'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:00 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:00 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:00 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401" returned: 0 in 0.848s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaed8dd8-2fd1-40e6-9a77-9ab964d32836]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:00 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cace99d6-d9a6-41df-b35a-c941b4b2a090_x3w9p1a7" returned: 0 in 0.879s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cace99d6-d9a6-41df-b35a-c941b4b2a090_x3w9p1a7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-5cbf3034-0e58-48d8-87e6-bb4147710b6f-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-5cbf3034-0e58-48d8-87e6-bb4147710b6f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:00 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 Jun 01 09:51:00 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-quobyte-5cbf3034-0e58-48d8-87e6-bb4147710b6f" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:00 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cace99d6-d9a6-41df-b35a-c941b4b2a090_x3w9p1a7 Jun 01 09:51:00 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-5cbf3034-0e58-48d8-87e6-bb4147710b6f" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2599b508-c9ba-401c-b34b-c971bfea24af]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:00 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f Jun 01 09:51:00 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:01 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.838s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:01 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Deleted volume successfully. Jun 01 09:51:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-023313e2-e00e-4e0c-96f2-5f03441cf86d tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-3c4caade-005c-4880-8aac-90edf37e87d7-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:01 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cace99d6-d9a6-41df-b35a-c941b4b2a090_x3w9p1a7" returned: 1 in 1.022s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cace99d6-d9a6-41df-b35a-c941b4b2a090_x3w9p1a7' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:51:01 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[374102ef-816d-4448-803f-7402dbd35962]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:01 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137" returned: 0 in 1.093s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:01 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Path /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 01 09:51:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:01 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903 Jun 01 09:51:01 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:01 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD Jun 01 09:51:01 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:01 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f" returned: 0 in 1.075s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:01 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f Jun 01 09:51:01 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:02 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD" returned: 0 in 0.945s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:02 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5cbf3034-0e58-48d8-87e6-bb4147710b6f" returned: 0 in 0.790s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:02 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD Jun 01 09:51:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-5cbf3034-0e58-48d8-87e6-bb4147710b6f" released by "delete_volume" :: held 1.942s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:02 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:02 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Created reservations ['df13392e-7754-4d6a-8ff4-0d30ce9f16bc', '567abda9-5fbd-4b8a-b91d-5b75565bf7fc', 'bf7230d8-79c0-4ecd-819c-f9dc76f6d745', '7b7fd950-f5d4-4cdb-acc5-430af96b460b'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:02 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:02 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-1fbcb970-d3b9-467c-9ffe-8a70530bbeab-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-1fbcb970-d3b9-467c-9ffe-8a70530bbeab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.101s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-quobyte-79d57bf5-feb1-47e2-88f3-43827df612bb" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-79d57bf5-feb1-47e2-88f3-43827df612bb" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-quobyte-1fbcb970-d3b9-467c-9ffe-8a70530bbeab" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-1fbcb970-d3b9-467c-9ffe-8a70530bbeab" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Deleting offline snapshot 1fbcb970-d3b9-467c-9ffe-8a70530bbeab of volume 79d57bf5-feb1-47e2-88f3-43827df612bb {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:51:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] snapshot_file for this snap is: volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:51:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[306bea3d-6837-458b-a914-e51cde285bc9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:03 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab Jun 01 09:51:03 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:03 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD" returned: 1 in 1.502s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:51:03 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] cace99d6-d9a6-41df-b35a-c941b4b2a090 was raw, converting to raw {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 01 09:51:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:04 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 Jun 01 09:51:04 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:04 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.872s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:04 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:04 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Deleted volume successfully. Jun 01 09:51:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e2771f57-416d-4898-be3a-e189ca096b9b tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-5cbf3034-0e58-48d8-87e6-bb4147710b6f-delete_volume" released by "delete_volume" :: held 4.367s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:05 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab" returned: 0 in 2.047s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79d57bf5-feb1-47e2-88f3-43827df612bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:51:05 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc37797-9e46-4167-819f-d673f43f2f7e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:05 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3" returned: 0 in 1.832s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:05 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cace99d6-d9a6-41df-b35a-c941b4b2a090_q9yc9f3wdevstack@QuobyteHD, size 0.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:51:05 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Converted 0.00 MB image at 0.00 MB/s Jun 01 09:51:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:05 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 1G Jun 01 09:51:05 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:05 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb Jun 01 09:51:05 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:07 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 1G" returned: 0 in 1.429s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:07 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[429b7deb-5ea2-487f-8ce0-5d1e22b7de1a]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:07 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 Jun 01 09:51:07 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:08 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb" returned: 0 in 2.600s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:08 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab Jun 01 09:51:08 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:08 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903" returned: 0 in 7.227s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:08 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca97332-2224-4dd7-b99b-35377393d725]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:08 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 Jun 01 09:51:08 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:08 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3" returned: 0 in 1.548s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:09 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 Jun 01 09:51:09 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:09 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab" returned: 0 in 1.045s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:09 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab Jun 01 09:51:09 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:09 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3" returned: 1 in 0.877s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Downloaded image cace99d6-d9a6-41df-b35a-c941b4b2a090 ((None, [{'url': 'file:///opt/stack/data/glance/images/cace99d6-d9a6-41df-b35a-c941b4b2a090', 'metadata': {}}])) to volume 0a6bd39c-c0f6-4961-b56d-15b00be401b3 successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Temporary image cace99d6-d9a6-41df-b35a-c941b4b2a090 for user 5f2fa6bd473d40dd92ba6f637698e5d1 is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Marking volume 0a6bd39c-c0f6-4961-b56d-15b00be401b3 as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=127,cinder:INSERT=48,cinder:UPDATE=173,cinder:DELETE=15 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Copying metadata from image cace99d6-d9a6-41df-b35a-c941b4b2a090 to 0a6bd39c-c0f6-4961-b56d-15b00be401b3. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Creating volume glance metadata for volume 0a6bd39c-c0f6-4961-b56d-15b00be401b3 backed by image cace99d6-d9a6-41df-b35a-c941b4b2a090 with: {'image_id': 'cace99d6-d9a6-41df-b35a-c941b4b2a090', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2bbd7f7ce1e651f43c0983e998ff34f6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 01 09:51:09 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137" returned: 0 in 1.138s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Image conversion details: src /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137, size 1024.00 MB, duration 7.23 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:51:09 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Converted 1024.00 MB image at 141.63 MB/s Jun 01 09:51:09 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903 is being set with open permissions: ugo+rw Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30450c88-400f-475e-97bb-dcdedcbc989e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3', 'volume_size': 1, 'image_id': 'cace99d6-d9a6-41df-b35a-c941b4b2a090', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cace99d6-d9a6-41df-b35a-c941b4b2a090', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2bbd7f7ce1e651f43c0983e998ff34f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5fff9ea3fd024adc8fb75fa0fa4e288d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f780f690f6b60d5f3c65fdaf45a25f227ccd871739d5783753c81bf25e8cc85c0d853fb3b64fc423678c30327fe9cc877bde45d14242272f46cd513e466470e1', 'id': 'cace99d6-d9a6-41df-b35a-c941b4b2a090', 'created_at': datetime.datetime(2026, 6, 1, 7, 50, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 7, 50, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cace99d6-d9a6-41df-b35a-c941b4b2a090/file', 'properties': {}}, 'image_service': }' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3becf7e2-dea8-4f7a-a010-b4d8a66a9878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:09 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903 Jun 01 09:51:09 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:09 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Volume volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 (0a6bd39c-c0f6-4961-b56d-15b00be401b3): created successfully Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3becf7e2-dea8-4f7a-a010-b4d8a66a9878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Flow 'volume_create_manager' (8732afb1-4aae-4d05-87ae-dac7dfea3b64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1d6d9896-c112-4e77-83ce-d8ace66506a4 tempest-VolumeImageDependencyTests-2138866681 None] Created volume successfully. Jun 01 09:51:09 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb.1fbcb970-d3b9-467c-9ffe-8a70530bbeab" returned: 0 in 0.757s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-1fbcb970-d3b9-467c-9ffe-8a70530bbeab" released by "_delete_snapshot" :: held 6.710s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-79d57bf5-feb1-47e2-88f3-43827df612bb" released by "delete_snapshot" :: held 6.762s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Created reservations ['f0dae208-5f52-4542-b8e9-09d4e63f0ef8', 'a80a217b-dc81-4ad0-9dda-bb96fc288be6', '764062f1-7cc6-4190-8b02-1ae25d4b65ac', '5452810b-ee29-4cc2-a62d-488a965aa923'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Delete snapshot completed successfully. Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3de325e3-f5ad-4c8b-9a0b-be92cf9ccc8c tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-1fbcb970-d3b9-467c-9ffe-8a70530bbeab-delete_snapshot" released by "delete_snapshot" :: held 6.935s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:10 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903" returned: 0 in 0.670s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-quobyte-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903" released by "_copy_volume_from_snapshot" :: held 11.113s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-quobyte-e4cf2da2-4ade-4b59-829a-1db9964f0401-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903" released by "_create_volume_from_snapshot" :: held 11.159s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.193s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Acquiring lock "cinder-0a6bd39c-c0f6-4961-b56d-15b00be401b3-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65b8583-447a-436e-8f05-897ec84bf180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903', 'volume_size': 1, 'snapshot_id': 'e4cf2da2-4ade-4b59-829a-1db9964f0401'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbafeea-797e-4dec-9d5c-820b7143de40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Lock "cinder-0a6bd39c-c0f6-4961-b56d-15b00be401b3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:10 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Volume volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903 (5ef68f84-5e64-40c5-ba7b-a2c30e3bb903): created successfully Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbafeea-797e-4dec-9d5c-820b7143de40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Flow 'volume_create_manager' (daddda04-b92f-4c3f-8ce2-664c88817142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-be2b2d25-398b-4d86-85ae-80e6e0dcb606 tempest-VolumeDependencyTests-1819099694 None] Created volume successfully. Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Acquiring lock "cinder-quobyte-0a6bd39c-c0f6-4961-b56d-15b00be401b3" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Lock "cinder-quobyte-0a6bd39c-c0f6-4961-b56d-15b00be401b3" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "cinder-e4cf2da2-4ade-4b59-829a-1db9964f0401-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6efcc34-fe4e-4acf-8b9b-4961a5251df7]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-e4cf2da2-4ade-4b59-829a-1db9964f0401-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "cinder-quobyte-a1e9d30a-93b9-4a4c-9bab-21f6af53d137" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-quobyte-a1e9d30a-93b9-4a4c-9bab-21f6af53d137" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "cinder-quobyte-e4cf2da2-4ade-4b59-829a-1db9964f0401" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-quobyte-e4cf2da2-4ade-4b59-829a-1db9964f0401" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Deleting offline snapshot e4cf2da2-4ade-4b59-829a-1db9964f0401 of volume a1e9d30a-93b9-4a4c-9bab-21f6af53d137 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] snapshot_file for this snap is: volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-79d57bf5-feb1-47e2-88f3-43827df612bb-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[441c9d73-5dd9-4354-b98f-82860fb7666d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:10 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 Jun 01 09:51:10 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-79d57bf5-feb1-47e2-88f3-43827df612bb-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "cinder-quobyte-79d57bf5-feb1-47e2-88f3-43827df612bb" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-79d57bf5-feb1-47e2-88f3-43827df612bb" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:11 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6893a097-7ef1-44c6-aa6f-eb4a5987ddd5]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:11 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 Jun 01 09:51:11 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:11 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb Jun 01 09:51:11 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:11 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3" returned: 0 in 0.925s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:11 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401" returned: 0 in 0.930s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:51:11 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 Jun 01 09:51:11 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:11 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[966bc8f9-cfbc-4e45-bf8b-b5d61faee32d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:11 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb" returned: 0 in 0.854s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:11 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb Jun 01 09:51:11 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:11 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 Jun 01 09:51:11 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:12 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3" returned: 1 in 0.892s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 01 09:51:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:12 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3 Jun 01 09:51:12 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:12 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-79d57bf5-feb1-47e2-88f3-43827df612bb" returned: 0 in 0.728s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-quobyte-79d57bf5-feb1-47e2-88f3-43827df612bb" released by "delete_volume" :: held 1.661s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:12 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Created reservations ['3099ddb0-2780-4709-9e9c-2f829530868a', '2c2a73d5-77b6-44e5-9e5f-14d9674a7e7e', '57165ce1-52c5-41e1-838c-1245850c08c5', '524a3755-a12a-47b0-b05d-f7a60ac91c24'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:12 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137" returned: 0 in 0.946s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:12 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 Jun 01 09:51:12 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:12 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:12 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:13 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0a6bd39c-c0f6-4961-b56d-15b00be401b3" returned: 0 in 0.765s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Lock "cinder-quobyte-0a6bd39c-c0f6-4961-b56d-15b00be401b3" released by "delete_volume" :: held 2.679s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:13 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Created reservations ['ed4fdcbf-768b-4b35-8c27-1a3058844c65', '2ad0597d-4f39-4a63-999c-39cda34b37d6', '18cbf548-a728-46bf-8a7a-b12b2db87723', 'e623c585-b8a9-46d7-ab7a-ee0d287fe1cf'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:13 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:13 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:13 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.765s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:13 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Deleted volume successfully. Jun 01 09:51:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-467beb94-5cb2-4b9c-aa65-9d13291c8341 tempest-CreateVolumesFromSnapshotTest-687761034 None] Lock "cinder-79d57bf5-feb1-47e2-88f3-43827df612bb-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:13 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401" returned: 0 in 0.963s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:13 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401 Jun 01 09:51:13 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:14 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.022s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:14 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Deleted volume successfully. Jun 01 09:51:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-efaf51e0-4680-4bdf-bec5-224410634b3f tempest-VolumeImageDependencyTests-2138866681 None] Lock "cinder-0a6bd39c-c0f6-4961-b56d-15b00be401b3-delete_volume" released by "delete_volume" :: held 4.047s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:14 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137.e4cf2da2-4ade-4b59-829a-1db9964f0401" returned: 0 in 1.036s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-quobyte-e4cf2da2-4ade-4b59-829a-1db9964f0401" released by "_delete_snapshot" :: held 4.024s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-quobyte-a1e9d30a-93b9-4a4c-9bab-21f6af53d137" released by "delete_snapshot" :: held 4.052s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:14 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Created reservations ['f6707361-b0ab-4897-8d3d-9efe4948ceef', 'b5b9e7d5-b977-475c-b516-32664626195f', '88ca22f5-b667-470a-9579-bca351d13fa4', 'f16be9ad-4807-41bc-b150-8861361d6851'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Delete snapshot completed successfully. Jun 01 09:51:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5c04f55f-be4f-414b-8366-c6db1a5dcb03 tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-e4cf2da2-4ade-4b59-829a-1db9964f0401-delete_snapshot" released by "delete_snapshot" :: held 4.266s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "cinder-a1e9d30a-93b9-4a4c-9bab-21f6af53d137-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-a1e9d30a-93b9-4a4c-9bab-21f6af53d137-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "cinder-quobyte-a1e9d30a-93b9-4a4c-9bab-21f6af53d137" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-quobyte-a1e9d30a-93b9-4a4c-9bab-21f6af53d137" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeffdb95-b1c6-4ab3-a644-5bedd5fb0fe4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:16 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 Jun 01 09:51:16 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:17 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137" returned: 0 in 0.899s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:17 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137 Jun 01 09:51:17 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:17 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-a1e9d30a-93b9-4a4c-9bab-21f6af53d137" returned: 0 in 0.720s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-quobyte-a1e9d30a-93b9-4a4c-9bab-21f6af53d137" released by "delete_volume" :: held 1.696s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Created reservations ['41afbf99-27bf-4596-90bf-190e21a8420e', '6cd85107-346d-415b-989a-b94a644f6f8b', 'e0f6695f-46d5-40df-b36e-00fa1a54d795', '44045257-7ae6-4aff-9081-460de627ae16'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:18 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:18 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "cinder-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Flow 'volume_create_manager' (6ea687b2-20c1-4d25-a186-434a7a19e530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfede6b-5b7b-411f-ad20-1e3fc4967e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfede6b-5b7b-411f-ad20-1e3fc4967e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312836594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b76b545-e662-4803-9ae5-fdaa9c04c168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1803fbf86a3d466a96ecdcc1b590e98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:18Z,use_quota=True,user_id='21bd2db166664d3789f983218f421567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdea2720-139d-49d5-90b6-c2862c3f895e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdea2720-139d-49d5-90b6-c2862c3f895e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b6083d-8429-4fd6-bea4-0c5f2d9f305c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b6083d-8429-4fd6-bea4-0c5f2d9f305c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b76b545-e662-4803-9ae5-fdaa9c04c168', 'volume_name': 'volume-1b76b545-e662-4803-9ae5-fdaa9c04c168', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bda4883-c252-401f-99c8-32b83fabbd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bda4883-c252-401f-99c8-32b83fabbd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc78aa2-9aca-44a7-ba62-25b0d67a9448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:18 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume 1b76b545-e662-4803-9ae5-fdaa9c04c168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b76b545-e662-4803-9ae5-fdaa9c04c168', 'volume_size': 1} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312836594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b76b545-e662-4803-9ae5-fdaa9c04c168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1803fbf86a3d466a96ecdcc1b590e98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:18Z,use_quota=True,user_id='21bd2db166664d3789f983218f421567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Creating volume 1b76b545-e662-4803-9ae5-fdaa9c04c168 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:51:18 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b76b545-e662-4803-9ae5-fdaa9c04c168 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:18 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b76b545-e662-4803-9ae5-fdaa9c04c168 1073741824 Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "cinder-quobyte-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:18 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-quobyte-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c92950-b792-4b29-a2e1-1a2d27187270]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:18 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.690s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Deleted volume successfully. Jun 01 09:51:18 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903 Jun 01 09:51:18 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d2905af3-61ff-48f2-ac8e-7dbdcb38d431 tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-a1e9d30a-93b9-4a4c-9bab-21f6af53d137-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:19 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903" returned: 0 in 0.799s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:19 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b76b545-e662-4803-9ae5-fdaa9c04c168 1073741824" returned: 0 in 0.912s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:19 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903 Jun 01 09:51:19 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b76b545-e662-4803-9ae5-fdaa9c04c168 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:19 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b76b545-e662-4803-9ae5-fdaa9c04c168 Jun 01 09:51:19 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:20 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:20 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903" returned: 0 in 0.678s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b76b545-e662-4803-9ae5-fdaa9c04c168" returned: 0 in 0.631s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-quobyte-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903" released by "delete_volume" :: held 1.523s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc78aa2-9aca-44a7-ba62-25b0d67a9448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b76b545-e662-4803-9ae5-fdaa9c04c168', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c53b739-e383-404e-8a3b-c68c8e2b7ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:20 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume volume-1b76b545-e662-4803-9ae5-fdaa9c04c168 (1b76b545-e662-4803-9ae5-fdaa9c04c168): created successfully Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c53b739-e383-404e-8a3b-c68c8e2b7ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Flow 'volume_create_manager' (6ea687b2-20c1-4d25-a186-434a7a19e530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f20bbaa5-91f8-449c-90c4-6d5d5a22685a tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Created volume successfully. Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Created reservations ['dc2a7c93-6751-45ff-8934-efbec5bd624d', '578e90d5-7eb9-48d9-920d-41b2f8934cfb', '2f2b7bb8-365b-4a76-90a0-983f597f98b3', '0ed39783-1d03-4307-b8b3-b40abe51380b'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:20 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:20 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:20 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.622s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:21 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Deleted volume successfully. Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d6eeacb4-6bba-42c6-85ef-13e191495e3b tempest-VolumeDependencyTests-1819099694 None] Lock "cinder-5ef68f84-5e64-40c5-ba7b-a2c30e3bb903-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Flow 'volume_create_manager' (3ca7bd1f-3455-49f3-ba56-5b6a09d403b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84b8262-ed4a-4de9-a424-3d30e43066f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84b8262-ed4a-4de9-a424-3d30e43066f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1742535250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faed925a-1d0f-478a-9143-a3f15e559d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1803fbf86a3d466a96ecdcc1b590e98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:21Z,use_quota=True,user_id='21bd2db166664d3789f983218f421567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da99ca39-1176-4481-a5b5-1b68a4c55b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da99ca39-1176-4481-a5b5-1b68a4c55b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecb4d81-155a-444e-85aa-501982ea2439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecb4d81-155a-444e-85aa-501982ea2439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faed925a-1d0f-478a-9143-a3f15e559d7c', 'volume_name': 'volume-faed925a-1d0f-478a-9143-a3f15e559d7c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c061a61a-5fac-4983-96e4-16cb1e811634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c061a61a-5fac-4983-96e4-16cb1e811634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81fb59a5-93e3-4c5b-a568-9ddc7354a276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:21 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume faed925a-1d0f-478a-9143-a3f15e559d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faed925a-1d0f-478a-9143-a3f15e559d7c', 'volume_size': 1} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1742535250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faed925a-1d0f-478a-9143-a3f15e559d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1803fbf86a3d466a96ecdcc1b590e98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:21Z,use_quota=True,user_id='21bd2db166664d3789f983218f421567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Creating volume faed925a-1d0f-478a-9143-a3f15e559d7c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:51:21 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-faed925a-1d0f-478a-9143-a3f15e559d7c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:21 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-faed925a-1d0f-478a-9143-a3f15e559d7c 1073741824 Jun 01 09:51:21 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Flow 'volume_create_manager' (8bf42a24-9dc8-4c51-8914-73359a83b171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef1d809-f98a-4c59-b971-4fa1f43c9ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef1d809-f98a-4c59-b971-4fa1f43c9ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1755969540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225b58fe-1e3e-4f7e-ab8d-32882024aa38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1803fbf86a3d466a96ecdcc1b590e98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:22Z,use_quota=True,user_id='21bd2db166664d3789f983218f421567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f595c7ea-093b-43d2-b119-aab9d570cf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f595c7ea-093b-43d2-b119-aab9d570cf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307bc483-b2aa-4362-92e2-c15a62b5e7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307bc483-b2aa-4362-92e2-c15a62b5e7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '225b58fe-1e3e-4f7e-ab8d-32882024aa38', 'volume_name': 'volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d722bc-acf5-4662-8966-55d753121323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d722bc-acf5-4662-8966-55d753121323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565a1fa9-87e0-42cd-a7d5-6db1117ec1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:21 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume 225b58fe-1e3e-4f7e-ab8d-32882024aa38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38', 'volume_size': 1} Jun 01 09:51:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:51:22 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Flow 'volume_create_manager' (fa09de9d-5ee5-40fe-94f1-a6820d2d683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3781f5d2-d55d-49f1-8ca8-61b0072b1b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-faed925a-1d0f-478a-9143-a3f15e559d7c 1073741824" returned: 0 in 1.087s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3781f5d2-d55d-49f1-8ca8-61b0072b1b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1537971658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa3d0a6-3604-4521-8be9-69f97d0eefb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1803fbf86a3d466a96ecdcc1b590e98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:22Z,use_quota=True,user_id='21bd2db166664d3789f983218f421567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f894651-b3fe-4bed-a509-0eee8cf31ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f894651-b3fe-4bed-a509-0eee8cf31ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794c20c5-5fc5-43c3-be25-007b2db3c05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794c20c5-5fc5-43c3-be25-007b2db3c05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aa3d0a6-3604-4521-8be9-69f97d0eefb8', 'volume_name': 'volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b49a1d-d5c8-4e7b-a57a-b49044841c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b49a1d-d5c8-4e7b-a57a-b49044841c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eff8fac-35af-4b5e-9785-7d067bba78ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:22 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume 1aa3d0a6-3604-4521-8be9-69f97d0eefb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8', 'volume_size': 1} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-faed925a-1d0f-478a-9143-a3f15e559d7c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:22 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-faed925a-1d0f-478a-9143-a3f15e559d7c Jun 01 09:51:22 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Flow 'volume_create_manager' (75b9c382-7243-4851-be00-c767688eed18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cc7fc1-8e69-4816-86ae-c3f002c65852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cc7fc1-8e69-4816-86ae-c3f002c65852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1879856199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f09a92-8ba0-4d88-a8e1-a39e54685a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1803fbf86a3d466a96ecdcc1b590e98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:23Z,use_quota=True,user_id='21bd2db166664d3789f983218f421567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cac550-ed9e-4b5a-9ec0-a1947b7a6a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cac550-ed9e-4b5a-9ec0-a1947b7a6a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba52a38-b211-4073-b3ae-ac0b16d43e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba52a38-b211-4073-b3ae-ac0b16d43e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7f09a92-8ba0-4d88-a8e1-a39e54685a99', 'volume_name': 'volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1253751-ff81-4a2d-8a80-5aa637d9fb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1253751-ff81-4a2d-8a80-5aa637d9fb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85580e9a-06c1-425a-819b-80a6e80ddd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:22 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume e7f09a92-8ba0-4d88-a8e1-a39e54685a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99', 'volume_size': 1} Jun 01 09:51:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:23 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-faed925a-1d0f-478a-9143-a3f15e559d7c" returned: 0 in 0.735s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.270s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1755969540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225b58fe-1e3e-4f7e-ab8d-32882024aa38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1803fbf86a3d466a96ecdcc1b590e98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:22Z,use_quota=True,user_id='21bd2db166664d3789f983218f421567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Creating volume 225b58fe-1e3e-4f7e-ab8d-32882024aa38 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:51:23 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:23 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38 1073741824 Jun 01 09:51:23 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81fb59a5-93e3-4c5b-a568-9ddc7354a276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faed925a-1d0f-478a-9143-a3f15e559d7c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8228636-6656-4813-bb1d-2a23952c4e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:23 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume volume-faed925a-1d0f-478a-9143-a3f15e559d7c (faed925a-1d0f-478a-9143-a3f15e559d7c): created successfully Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8228636-6656-4813-bb1d-2a23952c4e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Flow 'volume_create_manager' (3ca7bd1f-3455-49f3-ba56-5b6a09d403b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Flow 'volume_create_manager' (e3bd0296-7d40-478b-afe4-2506bf397fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677169a5-a820-4ead-86c8-9daef582d5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Flow 'volume_create_manager' (cbbc7aca-d789-4cbe-a618-cef5f0aff84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8298fd81-359c-4b94-9be2-cdee799e6a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-861fc1be-5f7c-460b-b976-434457091908 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Created volume successfully. Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677169a5-a820-4ead-86c8-9daef582d5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-508087166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968820e0724243b6894438ec20cee746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:23Z,use_quota=True,user_id='283635d3dfdc414eaedd4953d51951e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e732f2-ffc9-43a9-aa10-3d2ac77d7849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e732f2-ffc9-43a9-aa10-3d2ac77d7849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b811871-feca-4910-b94a-3b035af6343c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b811871-feca-4910-b94a-3b035af6343c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc', 'volume_name': 'volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5638e56-7ac1-4212-8f1d-8568d2d8c745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5638e56-7ac1-4212-8f1d-8568d2d8c745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e39a239-38fc-46b1-ac86-9604c5b214f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:23 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Volume c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc', 'volume_size': 1} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8298fd81-359c-4b94-9be2-cdee799e6a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-778476326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f874fc-b6ff-4e15-b9aa-b2156f4f80d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1803fbf86a3d466a96ecdcc1b590e98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:23Z,use_quota=True,user_id='21bd2db166664d3789f983218f421567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e8471d-24e2-4f13-839c-fc397bbc4dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e8471d-24e2-4f13-839c-fc397bbc4dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f9f144-8303-46ee-aeac-c44d4afbedf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f9f144-8303-46ee-aeac-c44d4afbedf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f874fc-b6ff-4e15-b9aa-b2156f4f80d6', 'volume_name': 'volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a858e97b-2f1e-4cd4-ba32-0f2b69aacb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a858e97b-2f1e-4cd4-ba32-0f2b69aacb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da793c40-2465-4028-a190-082275042739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:23 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume 00f874fc-b6ff-4e15-b9aa-b2156f4f80d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6', 'volume_size': 1} Jun 01 09:51:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:24 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38 1073741824" returned: 0 in 0.764s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:24 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38 Jun 01 09:51:24 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:24 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38" returned: 0 in 0.582s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.167s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1537971658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa3d0a6-3604-4521-8be9-69f97d0eefb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1803fbf86a3d466a96ecdcc1b590e98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:22Z,use_quota=True,user_id='21bd2db166664d3789f983218f421567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Creating volume 1aa3d0a6-3604-4521-8be9-69f97d0eefb8 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:51:24 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565a1fa9-87e0-42cd-a7d5-6db1117ec1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:24 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8 1073741824 Jun 01 09:51:24 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a56ff0-c236-4688-8758-d63e31307650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:24 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38 (225b58fe-1e3e-4f7e-ab8d-32882024aa38): created successfully Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a56ff0-c236-4688-8758-d63e31307650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Flow 'volume_create_manager' (8bf42a24-9dc8-4c51-8914-73359a83b171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:24 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c6dc9be8-42a3-4fb7-9b5a-22b8305cf9e8 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Created volume successfully. Jun 01 09:51:25 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8 1073741824" returned: 0 in 0.785s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:25 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8 Jun 01 09:51:25 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:26 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8" returned: 0 in 0.571s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.159s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1879856199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f09a92-8ba0-4d88-a8e1-a39e54685a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1803fbf86a3d466a96ecdcc1b590e98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:23Z,use_quota=True,user_id='21bd2db166664d3789f983218f421567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Creating volume e7f09a92-8ba0-4d88-a8e1-a39e54685a99 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:51:26 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:26 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99 1073741824 Jun 01 09:51:26 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eff8fac-35af-4b5e-9785-7d067bba78ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1569aaeb-8b34-462f-9eff-5c34fa98707a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:26 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8 (1aa3d0a6-3604-4521-8be9-69f97d0eefb8): created successfully Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1569aaeb-8b34-462f-9eff-5c34fa98707a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Flow 'volume_create_manager' (fa09de9d-5ee5-40fe-94f1-a6820d2d683a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:26 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d686adc4-d1e9-46ef-88f6-c91dc288092c tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Created volume successfully. Jun 01 09:51:26 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99 1073741824" returned: 0 in 0.765s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:26 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99 Jun 01 09:51:26 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:27 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99" returned: 0 in 0.579s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.968s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-508087166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968820e0724243b6894438ec20cee746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:23Z,use_quota=True,user_id='283635d3dfdc414eaedd4953d51951e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Creating volume c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:51:27 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85580e9a-06c1-425a-819b-80a6e80ddd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:27 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc 1073741824 Jun 01 09:51:27 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc0b18a-1530-41fa-b1e9-b3395b7e3267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:27 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99 (e7f09a92-8ba0-4d88-a8e1-a39e54685a99): created successfully Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc0b18a-1530-41fa-b1e9-b3395b7e3267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Flow 'volume_create_manager' (75b9c382-7243-4851-be00-c767688eed18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:27 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d752234a-ca9f-464a-9664-e2d43c463841 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Created volume successfully. Jun 01 09:51:28 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc 1073741824" returned: 0 in 0.752s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:28 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc Jun 01 09:51:28 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:28 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc" returned: 0 in 0.587s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.307s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-778476326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f874fc-b6ff-4e15-b9aa-b2156f4f80d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1803fbf86a3d466a96ecdcc1b590e98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:23Z,use_quota=True,user_id='21bd2db166664d3789f983218f421567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Creating volume 00f874fc-b6ff-4e15-b9aa-b2156f4f80d6 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:51:28 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] casted to osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:28 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6 1073741824 Jun 01 09:51:28 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e39a239-38fc-46b1-ac86-9604c5b214f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe510a5-7baa-4bef-896f-cba52086d6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Volume volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc (c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc): created successfully Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe510a5-7baa-4bef-896f-cba52086d6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Flow 'volume_create_manager' (e3bd0296-7d40-478b-afe4-2506bf397fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-68399e24-39d4-4875-b9e5-cdf52fd773ee tempest-SnapshotDependencyTests-1670211386 None] Created volume successfully. Jun 01 09:51:29 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6 1073741824" returned: 0 in 0.750s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:29 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6 Jun 01 09:51:29 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:30 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6" returned: 0 in 0.609s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.435s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da793c40-2465-4028-a190-082275042739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40659a17-9c0e-4258-9640-ce6da612fcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] Creating offline snapshot a8e67261-87d8-4db6-bc44-cfa8d8654403 of volume c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 01 09:51:30 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Volume volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6 (00f874fc-b6ff-4e15-b9aa-b2156f4f80d6): created successfully Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40659a17-9c0e-4258-9640-ce6da612fcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Flow 'volume_create_manager' (cbbc7aca-d789-4cbe-a618-cef5f0aff84e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c54a85-8800-4449-969e-7a42bace0abc]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-79d1d2a2-c58e-4fe9-b6ab-4e341236ed23 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Created volume successfully. Jun 01 09:51:30 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc Jun 01 09:51:30 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "cinder-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "cinder-quobyte-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-quobyte-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d77442e-989d-4c7e-bdde-6c7d130c91a4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:31 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc" returned: 0 in 0.708s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:31 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6 Jun 01 09:51:31 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:31 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 1G Jun 01 09:51:31 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:31 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6" returned: 0 in 0.708s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:31 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6 Jun 01 09:51:31 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:31 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 1G" returned: 0 in 0.713s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:31 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 Jun 01 09:51:31 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:32 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6" returned: 0 in 0.601s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-quobyte-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6" released by "delete_volume" :: held 1.347s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:32 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Created reservations ['718de809-4221-4491-8238-a0a91f8f90ca', 'fbb8d8df-9d93-4f0c-a911-2ca5132c21ac', '6ca2b925-0c27-4e07-b88f-f7c7a3c43e69', 'be3a9087-c931-4ba2-bc90-52f53b0b4800'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:32 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc -F qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403" returned: 0 in 0.643s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:32 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 is being set with open permissions: ugo+rw Jun 01 09:51:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:32 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:32 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:32 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 Jun 01 09:51:32 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:32 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.601s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:32 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Deleted volume successfully. Jun 01 09:51:32 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403" returned: 0 in 0.610s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f2f5faf4-83a8-4f22-ac36-42b3a03d4270 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-00f874fc-b6ff-4e15-b9aa-b2156f4f80d6-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:33 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.info Jun 01 09:51:33 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "cinder-e7f09a92-8ba0-4d88-a8e1-a39e54685a99-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-e7f09a92-8ba0-4d88-a8e1-a39e54685a99-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "cinder-quobyte-e7f09a92-8ba0-4d88-a8e1-a39e54685a99" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-quobyte-e7f09a92-8ba0-4d88-a8e1-a39e54685a99" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:33 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef796c6-f0a8-4782-9a45-34460cab8f28]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:33 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99 Jun 01 09:51:33 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:33 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.info" returned: 0 in 0.624s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:33 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.info is being set with open permissions: ugo+rw Jun 01 09:51:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:33 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.info Jun 01 09:51:33 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:33 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99" returned: 0 in 0.719s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:33 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99 Jun 01 09:51:33 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:34 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.info" returned: 0 in 0.611s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.070s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8c4be593-6f72-4342-8bdf-9b87722d582e tempest-SnapshotDependencyTests-1670211386 None] Create snapshot completed successfully Jun 01 09:51:34 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-e7f09a92-8ba0-4d88-a8e1-a39e54685a99" returned: 0 in 0.580s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-quobyte-e7f09a92-8ba0-4d88-a8e1-a39e54685a99" released by "delete_volume" :: held 1.338s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:34 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Created reservations ['d9a1dc6d-f6d4-4a4e-b86b-6810324b6d15', 'd27d62d9-cacf-4cce-954d-826f17d66a71', '6607b0ed-5f4e-4962-ac36-ffc9e2c5a5f1', 'fe69cc02-f744-4ba5-b178-1b84dec32d4b'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:34 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:34 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:35 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.607s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:35 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Deleted volume successfully. Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19248f27-3275-4d69-93ca-7214ff57ba45 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-e7f09a92-8ba0-4d88-a8e1-a39e54685a99-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "cinder-1aa3d0a6-3604-4521-8be9-69f97d0eefb8-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-1aa3d0a6-3604-4521-8be9-69f97d0eefb8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "cinder-quobyte-1aa3d0a6-3604-4521-8be9-69f97d0eefb8" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-quobyte-1aa3d0a6-3604-4521-8be9-69f97d0eefb8" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aec693-757b-429a-906f-c85445b9e71f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:35 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8 Jun 01 09:51:35 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Flow 'volume_create_manager' (e310227b-e49e-4dc3-ab8e-b72a382fd55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e810e131-d994-4927-ba75-20e78957181c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e810e131-d994-4927-ba75-20e78957181c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T07:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fab3b95-dc22-4e7a-b710-aab43ede057a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968820e0724243b6894438ec20cee746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T07:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a8e67261-87d8-4db6-bc44-cfa8d8654403,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T07:51:36Z,use_quota=True,user_id='283635d3dfdc414eaedd4953d51951e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff45b09-4696-4b76-9de8-9cf6077a0738),volume_type_id=aff45b09-4696-4b76-9de8-9cf6077a0738)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52abe7aa-7639-4b9e-893a-0a3809457c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52abe7aa-7639-4b9e-893a-0a3809457c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6704899a-2b7a-40f2-8ccd-1799effd9fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6704899a-2b7a-40f2-8ccd-1799effd9fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0fab3b95-dc22-4e7a-b710-aab43ede057a', 'volume_name': 'volume-0fab3b95-dc22-4e7a-b710-aab43ede057a', 'volume_size': 1, 'snapshot_id': 'a8e67261-87d8-4db6-bc44-cfa8d8654403'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f37275a-b703-4904-b736-f7dd6fccebf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f37275a-b703-4904-b736-f7dd6fccebf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141bb01a-4b53-4fc4-8983-a71175e91177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:35 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Volume 0fab3b95-dc22-4e7a-b710-aab43ede057a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0fab3b95-dc22-4e7a-b710-aab43ede057a', 'volume_size': 1, 'snapshot_id': 'a8e67261-87d8-4db6-bc44-cfa8d8654403'} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "cinder-quobyte-a8e67261-87d8-4db6-bc44-cfa8d8654403-0fab3b95-dc22-4e7a-b710-aab43ede057a" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-quobyte-a8e67261-87d8-4db6-bc44-cfa8d8654403-0fab3b95-dc22-4e7a-b710-aab43ede057a" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Creating volume 0fab3b95-dc22-4e7a-b710-aab43ede057a from snapshot a8e67261-87d8-4db6-bc44-cfa8d8654403 {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Selected osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "cinder-quobyte-0fab3b95-dc22-4e7a-b710-aab43ede057a" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-quobyte-0fab3b95-dc22-4e7a-b710-aab43ede057a" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] snapshot: a8e67261-87d8-4db6-bc44-cfa8d8654403, volume: 0fab3b95-dc22-4e7a-b710-aab43ede057a, {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[49232aee-3b95-401f-9940-e12fac32fc34]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:36 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 Jun 01 09:51:36 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:36 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8" returned: 0 in 0.695s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:36 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8 Jun 01 09:51:36 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:36 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403" returned: 0 in 0.710s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c954f6-93db-4449-8369-282282cf02d3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:36 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1aa3d0a6-3604-4521-8be9-69f97d0eefb8" returned: 0 in 0.576s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-quobyte-1aa3d0a6-3604-4521-8be9-69f97d0eefb8" released by "delete_volume" :: held 1.316s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:36 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:36 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Created reservations ['e3bda495-9244-42ed-b861-abfc686ed139', '52caf2ca-a94b-477f-b02e-714c0b5de2df', 'd88e46ac-48dc-42be-8841-c6f7944a3e16', '34a7b0a9-6646-4e93-b889-4be813b3dbfa'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:36 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc Jun 01 09:51:36 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:36 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:36 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:37 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.605s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-51f99061-0d00-4fd2-9c49-46dc82d0cb34 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:37 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc" returned: 0 in 0.692s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:37 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Path /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 01 09:51:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:37 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a Jun 01 09:51:37 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:37 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.594s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Deleted volume successfully. Jun 01 09:51:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-df3705c4-0829-4091-ba24-bbe5518b19b5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-1aa3d0a6-3604-4521-8be9-69f97d0eefb8-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "cinder-225b58fe-1e3e-4f7e-ab8d-32882024aa38-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-225b58fe-1e3e-4f7e-ab8d-32882024aa38-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "cinder-quobyte-225b58fe-1e3e-4f7e-ab8d-32882024aa38" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-quobyte-225b58fe-1e3e-4f7e-ab8d-32882024aa38" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b500d9-e56a-4abc-a50a-f51333ead417]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:37 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38 Jun 01 09:51:37 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:38 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38" returned: 0 in 0.906s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:38 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38 Jun 01 09:51:38 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:39 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-225b58fe-1e3e-4f7e-ab8d-32882024aa38" returned: 0 in 1.182s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-quobyte-225b58fe-1e3e-4f7e-ab8d-32882024aa38" released by "delete_volume" :: held 2.144s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:39 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Created reservations ['fa01e25d-6540-4243-b517-6a4fc19bbfc1', '9c1d8cab-98ab-4dd2-a5f3-2dbe33f06267', 'd9fa2dd4-a82c-44f4-82c1-069cd35cdd25', 'f4f5af36-9f2b-4ead-931a-bb813348e022'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:40 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:40 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:41 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 1.007s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:41 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Deleted volume successfully. Jun 01 09:51:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "cinder-faed925a-1d0f-478a-9143-a3f15e559d7c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b595420e-a4bf-4624-acc5-d16f12d6a94f tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-225b58fe-1e3e-4f7e-ab8d-32882024aa38-delete_volume" released by "delete_volume" :: held 3.548s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-faed925a-1d0f-478a-9143-a3f15e559d7c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "cinder-quobyte-faed925a-1d0f-478a-9143-a3f15e559d7c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-quobyte-faed925a-1d0f-478a-9143-a3f15e559d7c" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9728cf5e-899b-44a9-81f2-5fc731d024ec]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-faed925a-1d0f-478a-9143-a3f15e559d7c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:41 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-faed925a-1d0f-478a-9143-a3f15e559d7c Jun 01 09:51:41 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:42 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a" returned: 0 in 4.946s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:42 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf2da44-6d82-43ba-aa95-c58ef6456740]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:42 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-faed925a-1d0f-478a-9143-a3f15e559d7c" returned: 0 in 1.084s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-faed925a-1d0f-478a-9143-a3f15e559d7c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:42 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-faed925a-1d0f-478a-9143-a3f15e559d7c Jun 01 09:51:42 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:42 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc Jun 01 09:51:42 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:42 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-faed925a-1d0f-478a-9143-a3f15e559d7c" returned: 0 in 0.579s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-quobyte-faed925a-1d0f-478a-9143-a3f15e559d7c" released by "delete_volume" :: held 1.767s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Created reservations ['8f1370fa-2222-4f5b-b54b-e95565556fd8', 'f19cffaa-2c91-4c5c-887c-d2dc291e5355', '99e5bbef-4146-4638-acf1-4443f475e251', '6397ebba-0680-4a60-ba1f-fef1197e3c06'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:43 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:43 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:43 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc" returned: 0 in 0.842s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Image conversion details: src /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 01 09:51:43 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Converted 1024.00 MB image at 206.99 MB/s Jun 01 09:51:43 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a is being set with open permissions: ugo+rw Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:43 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a Jun 01 09:51:43 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "cinder-1b76b545-e662-4803-9ae5-fdaa9c04c168-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-1b76b545-e662-4803-9ae5-fdaa9c04c168-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "cinder-quobyte-1b76b545-e662-4803-9ae5-fdaa9c04c168" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-quobyte-1b76b545-e662-4803-9ae5-fdaa9c04c168" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0bd5f7-4b5f-4d9f-b07e-19aaf533e6f7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b76b545-e662-4803-9ae5-fdaa9c04c168 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:43 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b76b545-e662-4803-9ae5-fdaa9c04c168 Jun 01 09:51:43 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:43 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.625s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Deleted volume successfully. Jun 01 09:51:43 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a" returned: 0 in 0.583s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-quobyte-0fab3b95-dc22-4e7a-b710-aab43ede057a" released by "_copy_volume_from_snapshot" :: held 7.866s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-aa1e10d2-b45f-43e5-80ad-fc6875f893f5 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-faed925a-1d0f-478a-9143-a3f15e559d7c-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-quobyte-a8e67261-87d8-4db6-bc44-cfa8d8654403-0fab3b95-dc22-4e7a-b710-aab43ede057a" released by "_create_volume_from_snapshot" :: held 7.906s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.928s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141bb01a-4b53-4fc4-8983-a71175e91177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fab3b95-dc22-4e7a-b710-aab43ede057a', 'volume_size': 1, 'snapshot_id': 'a8e67261-87d8-4db6-bc44-cfa8d8654403'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da17a357-b7ac-4ca8-ab10-32c5f9ebf138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 01 09:51:43 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Volume volume-0fab3b95-dc22-4e7a-b710-aab43ede057a (0fab3b95-dc22-4e7a-b710-aab43ede057a): created successfully Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da17a357-b7ac-4ca8-ab10-32c5f9ebf138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 01 09:51:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Flow 'volume_create_manager' (e310227b-e49e-4dc3-ab8e-b72a382fd55b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 01 09:51:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7b30d6e6-58e5-47b9-890d-63b334d6b4c2 tempest-SnapshotDependencyTests-1670211386 None] Created volume successfully. Jun 01 09:51:44 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b76b545-e662-4803-9ae5-fdaa9c04c168" returned: 0 in 0.689s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b76b545-e662-4803-9ae5-fdaa9c04c168 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:44 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b76b545-e662-4803-9ae5-fdaa9c04c168 Jun 01 09:51:44 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "cinder-a8e67261-87d8-4db6-bc44-cfa8d8654403-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-a8e67261-87d8-4db6-bc44-cfa8d8654403-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "cinder-quobyte-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-quobyte-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "cinder-quobyte-a8e67261-87d8-4db6-bc44-cfa8d8654403" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-quobyte-a8e67261-87d8-4db6-bc44-cfa8d8654403" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Deleting offline snapshot a8e67261-87d8-4db6-bc44-cfa8d8654403 of volume c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] snapshot_file for this snap is: volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e04289e-0611-46b7-9969-731cff9b0705]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:44 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 Jun 01 09:51:44 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:44 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-1b76b545-e662-4803-9ae5-fdaa9c04c168" returned: 0 in 0.573s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-quobyte-1b76b545-e662-4803-9ae5-fdaa9c04c168" released by "delete_volume" :: held 1.306s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Created reservations ['8c5a006c-b18c-4222-bfbc-a1f3ad0a08a1', '7aac5cdb-a3a3-4650-81c1-bd71b2d80360', 'a8ae5be0-a339-400b-9604-b96a8f07eae2', 'bb6883b0-3980-4dbf-8af2-23103c386ed8'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:44 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:44 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:45 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403" returned: 0 in 0.714s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 01 09:51:45 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9a63f1-8d52-4614-8984-cd9ee4b52838]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:45 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc Jun 01 09:51:45 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:45 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.589s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:45 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Deleted volume successfully. Jun 01 09:51:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-78284d61-8718-4584-90b4-1a4c8b66c471 tempest-CreateVolumesFromSourceVolumeTest-2141118651 None] Lock "cinder-1b76b545-e662-4803-9ae5-fdaa9c04c168-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:46 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc" returned: 0 in 0.704s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:46 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 Jun 01 09:51:46 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:46 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403" returned: 0 in 0.732s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:46 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403 Jun 01 09:51:46 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:47 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc.a8e67261-87d8-4db6-bc44-cfa8d8654403" returned: 0 in 0.583s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-quobyte-a8e67261-87d8-4db6-bc44-cfa8d8654403" released by "_delete_snapshot" :: held 2.822s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-quobyte-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc" released by "delete_snapshot" :: held 2.846s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:47 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Created reservations ['0eaf82d7-ea40-4b42-8317-574fe990d5fd', '56abe177-b8d3-4af5-97b7-75a4e2b51fa8', 'fc9dbd89-1649-44a7-8684-b5e2d8f37dc1', 'ad6348c6-2ed6-4963-8efb-640c0e6b2a4a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Delete snapshot completed successfully. Jun 01 09:51:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-09f342f9-5139-472b-a957-d6e7ce64fcb2 tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-a8e67261-87d8-4db6-bc44-cfa8d8654403-delete_snapshot" released by "delete_snapshot" :: held 2.973s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "cinder-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "cinder-quobyte-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-quobyte-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:47 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d464ee5-0fb9-4332-b57d-4da185429448]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:47 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc Jun 01 09:51:47 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:48 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc" returned: 0 in 0.697s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:48 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc Jun 01 09:51:48 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:49 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc" returned: 0 in 0.568s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-quobyte-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc" released by "delete_volume" :: held 1.318s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Created reservations ['ab7ee764-2262-4950-9b45-dbf8962603d8', '27c5528b-a128-4283-b71a-f85e10370261', '1f011108-bf44-4ce2-858f-b3cc545e5eda', '80de327c-bb6c-4d17-adb3-6f07146fec00'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:49 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:49 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:49 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.578s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Deleted volume successfully. Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a2867c7b-2fd9-442b-9844-dfbb024f89db tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-c5f6d25d-ce1b-480e-9cbe-f915fb29f4cc-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "cinder-0fab3b95-dc22-4e7a-b710-aab43ede057a-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-0fab3b95-dc22-4e7a-b710-aab43ede057a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "cinder-quobyte-0fab3b95-dc22-4e7a-b710-aab43ede057a" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-quobyte-0fab3b95-dc22-4e7a-b710-aab43ede057a" acquired by "delete_volume" :: waited 0.012s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b891ea0d-6982-4991-b921-a93694131bea]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 01 09:51:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:50 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a Jun 01 09:51:50 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:50 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a" returned: 0 in 0.670s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:50 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a Jun 01 09:51:50 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:51 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e/volume-0fab3b95-dc22-4e7a-b710-aab43ede057a" returned: 0 in 0.588s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-quobyte-0fab3b95-dc22-4e7a-b710-aab43ede057a" released by "delete_volume" :: held 1.295s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:51:51 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Created reservations ['f0c955b1-d2ba-4a17-a0ad-f670077c40b7', '48af5fe8-ebac-4779-9d44-d9aca33b055a', '83c92c24-0bb1-4063-8553-4b4f81d3e1bd', '3b1932db-b03a-443d-9357-9faba0d0c085'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 01 09:51:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 01 09:51:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 01 09:51:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 01 09:51:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d32800fa-fca7-4c19-baf4-5d83a6de1e10'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 01 09:51:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 01 09:51:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 01 09:51:51 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e Jun 01 09:51:51 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 01 09:51:51 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jun 01 09:51:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71d9241aad799480671d8e50986cb43e" returned: 0 in 0.577s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 01 09:51:51 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 01 09:51:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Deleted volume successfully. Jun 01 09:51:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bc260934-1aa0-4609-99ca-7f184a67a794 tempest-SnapshotDependencyTests-1670211386 None] Lock "cinder-0fab3b95-dc22-4e7a-b710-aab43ede057a-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 01 09:52:01 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=106,cinder:UPDATE=156,cinder:INSERT=48,cinder:DELETE=16 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 01 09:52:01 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=108,cinder:INSERT=34,cinder:UPDATE=143,cinder:DELETE=8 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}